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Hello World 


Let’s get stuck in, and what better way than with the 
programmer’s best friend, the ‘Hello World’ application! Start 
by opening a terminal. Its current working directory will be your 
home directory. It’s probably a good idea to make a directory for 
the files we'll be creating in this tutorial, rather than having them 
loose in your home directory. You can create a directory called 
Python using the command . You'll then want to 
change into that directory using the command 

The next step is to create an empty file using the command 
‘touch’ followed by the filename. Our expert used the command 
. The final and most important part of 
setting up the file is making it executable. This allows us to run 
code inside the hello_world.py file. We do this with the command 
. Now that we have our file set up, we 
can go ahead and open it up in nano, or any text editor of your 
choice. Gedit is a great editor with syntax highlighting support 
that should be available on any distribution. You'll be able to 
install it using your package manager if you don’t have it already. 


[Lliam@liam-laptop ~]$ mkdir Python 
[Lliam@liam-laptop ~]$ cd Python/ 

[liam@liam-laptop Python]$ touch hello_world.py 
[Lliam@liam-laptop Python]$ chmod +x hello_world.py 
[liam@liam-laptop Python]$ nano hello_world.py 


Our Hello World program is very simple, it only needs two lines. 
The first line begins with a ‘shebang’ (the symbol #! — also known 
as a hashbang) followed by the path to the Python interpreter. 
The program loader uses this line to work out what the rest of the 
lines need to be interpreted with. If you’re running this in an IDE 
like IDLE, you don’t necessarily need to do this. 

The code that is actually read by the Python interpreter is only 
a single line. We’re passing the value Hello World to the print 
function by placing it in brackets immediately after we’ve called 
the print function. Hello World is enclosed in quotation marks to 
indicate that it is a literal value and should not be interpreted as 
source code. As expected, the print function in Python prints any 
value that gets passed to it from the console. 

You can save the changes you’ve just made to the file in nano 
using the key combination Ctrl+0, followed by Enter. Use Ctrl+X 
to exit nano. 


#!/usr/bin/env python2 
print(“Hello World”) 


You can run the Hello World program by _prefixing 
its filename with / - in this case you'd type: 


[Lliam@liam-laptop Python]$ ./hello_world.py 
Hello World 


If you were using a graphical 
editor such as gedit, then 
you would only have to do 
the last step of making the 
file executable. You should 
only have to mark the file as 
executable once. You can 
freely edit the file once it 

is executable. 
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Variables and data types 

A variable is a name in source code that is associated with an 
area in memory that you can use to store data, which is then 
called upon throughout the code. The data can be one of many 
types, including: 


Stores whole numbers 


Stores decimal numbers 
Can have a value of True or False 


Stores acollection of characters. “Hello 
World” is a string 


As well as these main data types, there are sequence types 
(technically, a string is a sequence type but is so commonly used 
we've classed it as a main data type): 


Contains a collection of data in a specific order 


(Oxeyay el arcu Mexe)it-Yequ[olaMianlanleie-lo)(-Mel-Ve-Wlan\ 
specific order 


A tuple would be used for something like a co-ordinate, 
containing an x and y value stored as a single variable, whereas 
a list is typically used to store larger collections. The data 
stored in a tuple is immutable because you aren’t able to 
change values of individual elements in a tuple. However, you 
candosoinalist. 

It will also be useful to know about Python’s dictionary 
type. A dictionary is a mapped data type. It stores data in 
key-value pairs. This means that you access values stored in 
the dictionary using that value’s corresponding key, which is 
different to how you would do it with a list. In a list, you would 
access an element of the list using that element’s index (a 
number representing the element’s position in the list). 

Let’s work on a program we can use to demonstrate how to 
use variables and different data types. It’s worth noting at 
this point that you don’t always have to specify data types 
in Python. Feel free to create this file in any editor you like. 
Everything will work just fine as long as you remember to make 
the file executable. We’re going to call ours 


"A variable is a name 
in source code that is 
associated with an area in 
memory that you can use to 
store data” 


An interpreted language such as Python is one where the source 
code is converted to machine code and then executed each time the 


feycolelc-lanNaulacom Malcaxellirclccvaimicepar-Kae)nn|e)i (ve llt-lave Ut-le(-RU (an ir-3 Om 
where the source code is only converted to machine code once - the 
resulting machine code is then executed each time the program runs. 


#/usr/bin/env python2 


# We create a variable by writing the name of the variable we want followed 
# by an equals sign, which is followed by the value we want to store in the 

# variable. For example, the following line creates a variable called 

# hello_str, containing the string Hello World. 

hello_str =“Hello World” 


| ello_int =21 
The same principal is true of 


Boolean values ~~ hello bool = True 


We create a tuple in the | hello_tuple = (21, 32) 


following way 


The following line creates an 
integer variable called hello_int 
with the # value of 21. Notice 
how it doesn’t need to go in 
quotation marks 


hello_list = [“Hello/, “this”, “is” “a’, “list’”] 
And a list in this way 
# This list now contains 5 strings. Notice that there are no spaces 
# between these strings so if you were to join them up so make a sentence 
# you'd have to add a space between each element. 


hello_list = list() 
hello_list.append(“Hello,’) 
hello_list.append(“this”) 
hello_list.append(“is”) 
hello_list.append(“a”) 
hello_list.append(‘list”) 


You could also create the 
same list in the following way 


# The first line creates an empty list and the following lines use the append 

# function of the list type to add elements to the list. This way of using a 

# list isn’t really very useful when working with strings you know of in 

# advance, but it can be useful when working with dynamic data such as user 
# input. This list will overwrite the first list without any warning as we 

# are using the same variable name as the previous list. 


We might as well create a 


dictionary while we're at it. hello_dict = {“first_name’”:“Liam’, 
Notice how we've aligned the “last name” : “Fraser” 
colons below to make the ne . " 


code tidy “eye_colour":“Blue”} 


# Let's access some elements inside our collections 

# We'll start by changing the value of the last string in our hello_list and 

# add an exclamation mark to the end. The “list” string is the 5th element 
# in the list. However, indexes in Python are zero-based, which means the 
# first element has an index of 0. 


Notice that there will now be 
two exclamation marks when 
we print the element 


print(hello_list[4]) 
hello_list[4] +=“ 
# The above line is the same as 
hello_list[4] = hello_list[4] +“!” 
print(hello_list[4]) 


At this point, it’s worth 
explaining that any text in 


a Python file that follows 
a # character will be 
ignored by the interpreter. 
This is so you can write 
comments in your code. 


“Any text in a Python file that follows a # 
character will be ignored” 


print(str(hello_tuple[0])) 

# We can't change the value of those elements like we just did with the list 
# Notice the use of the str function above to explicitly convert the integer 
# value inside the tuple to a string before printing it. 


Remember that tuples are 
immutable, although we can 
access the elements of them 
like so 


print(hello_dict[“first_name”] +“ + hello_dict[“last_name”] +“ has“ + 
hello_dict[“eye_colour”] +“ eyes.’) 


print(“{0} {1} has {2} eyes."format(hello_dict[“first_name’], 
hello_dict[“last_name’], 
hello_dict[“eye_colour’])) 


Let's create a sentence using the 
data in our hello_dict 


A tidier way of doing this 
would be to use Python's 
string formatter 


Control structures 

In programming, a control structure is any kind of statement that 
can change the path that the code execution takes. For example, a (psyco untae oil) SV Ko itel ately 
control structure that decided to end the program if a number was dictates which statement a block of code belongs 


less than 5 would look something like this: to. Indentation is mandatory in Python, whereas in 
other languages, sets of braces are used to organise 


code blocks. For this reason, it is essential that you 
use a consistent indentation style. Four spaces 

are typically used to represent a single level of 
indentation in Python. You can use tabs, but tabs are 
not well defined, especially if you happen to opena 
Lil (Wlavante)c-nuatelakeyarct-relivo)A 


#!/usr/bin/env python2 


import sys # Used for the sys.exit function 


int_condition = 5 


if int_condition < 6: 


sys.exit(“int_condition must be >= 6” ut / / 
ae The ‘for’ loop uses 
print(“int_condition was >= 6 - continuing”) 
a local copy, so 
The path that the code takes will depend on the value of ° 
the integer int_condition. The code in the ‘if’ block will only be changes IN the loop 
executed if the condition is true. The import statement is used I ° 7] 
to load the Python system library; the latter provides the exit Won E affect the list 
function, allowing you to exit the program, printing an error 
message. Notice that indentation (in this case four spaces per 
indent) is used to indicate which statement a block of code 
belongs to. 
‘If’ statements are probably the most commonly used control 
structures. Other control structures include: 
«For statements, which allow you to iterate over items in 
collections, or to repeat a piece of code a certain number 


of times; 
¢While statements, a loop that continues while the condition 


[liam@liam-laptop Python]$ ./construct.py 
How many integers? acd 
You must enter an integer 


[Lliam@liam-laptop Python]$ ./construct.py 
How many integers? 3 

Please enter integer 1: t 

You must enter an integer 

Please enter integer 1: 5 

Please enter integer 2: 2 

Please enter integer 3: 6 


APython list is similar to an 
array in other languages. A 
list (or tuple) in Python can is true. 


contain data of multiple We’re going to write a program that accepts user input from the 


types, which is not usually 
the case with arrays in other 
languages. For this reason, 
we recommend that you 
only store data of the same 
type in alist. This should 
almost always be the case 
anyway due to the nature of 
the way data ina list would 
be processed. 
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user to demonstrate how control structures work. We’re calling it 


The ‘for’ loop is using a local copy of the current value, which 
means any changes inside the loop won’t make any changes 
affecting the list. On the other hand however, the ‘while’ loop is 
directly accessing elements in the list, so you could change the list 
there should you want to do so. We will talk about variable scope in 
some more detail later on. The output from the above program is 
as follows: 


Using a for loop 
5 

2 

6 

Using a while loop 
5 

2 

6 


#!/usr/bin/env python2 


# We're going to write a program that will ask the user to input an arbitrary 
# number of integers, store them in a collection, and then demonstrate how the 


# collection would be used with various control structures. 
The number of integers we 
want in the list 


import sys # Used for the sys.exit function 
I target_int = raw_input(“How many integers? “) 
# By now, the variable target_int contains a string representation of 
# whatever the user typed. We need to try and convert that to an integer but 
# be ready to # deal with the error if it’s not. Otherwise the program will 
# crash. 
try: 
target_int = int(target_int) 


except ValueError: 
sys.exit(“You must enter an integer”) 


L Fins = listQ) 
These are used to keep track 
of how many integers we _ 
currently have count = 0 


# Keep asking for an integer until we have the required number 
while count < target_int: 
new_int = raw_input(“Please enter integer {0}: “format(count + 1)) 
isint = False 


If the above succeeds then isint try: 
will be set to true: isint =True 


> —[new_int = int(new_int) 


A list to store the integers 


except: 
print(“You must enter an integer”) 


# Only carry on if we have an integer. If not, we'll loop again 
# Notice below | use ==, which is different from =. The single equals is an 
# assignment operator whereas the double equals is a comparison operator. 


if isint == True: 
# Add the integer to the collection 
ints.append(new_int) 
# Increment the count by 1 


count += 1 
By now, the user has given up or 
we have a list filled with integers. 
We can loop through these in a int(“Usi a 
couple of ways. The first is with print( aa ator loop ) 
a for loop for value in ints: 


print(str(value)) 
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You can define defaults # Or with a while loop: 


for variables if you want . “bled ‘ ” 
seach igi elliie print(“Using a while loop”) 


function without passing # We already have the total above, but knowing the len function is very 
any variables through at # useful. 
all. You do this by putting total = len(ints) 
an equals sign after 
the variable name. For count = @ 
xampli ndo: while count < total: 
print(str(intsLcount])) 
count += 1 


Functions and variable scope 

Functions are used in programming to break processes down into smaller 
chunks. This often makes code much easier to read. Functions can also be 
reusable if designed in a certain way. Functions can have variables passed 
to them. Variables in Python are always passed by value, which means that 
a copy of the variable is passed to the function that is only valid in the scope 
of the function. Any changes made to the original variable inside the function 
will be discarded. However, functions can also return values, so this isn’t 
an issue. Functions are defined with the keyword def, followed by the 
name of the function. Any variables that can be passed through are put in 
brackets following the function’s name. Multiple variables are separated by 
commas. The names given to the variables in these brackets are the ones 


#!/usr/bin/env python2 


scope. 
def modify_string(original): 


that they will have in the scope of the function, regardless of what 
the variable that’s passed to the function is called. Let’s see this 
in action. 

The output from the program opposite is as follows: 


“Functions are used in 
programming to break 
processes down in" 


Below is a function called modify_string, which accepts a variable 
that will be called original in the scope of the function. Anything 
# indented with 4 spaces under the function definition is in the 


original += “ that has been modified.” 
# At the moment, only the local copy of this string has been modified 


def modify_string_return(original): 
original += “ that has been modified.” 
# However, we can return our local copy to the caller. The function 


We are now outside of 
the scope of the modify_ 
string function, as we 


# ends as soon as the return statement is used, regardless of where it 
# is in the function. 
return original 


have reduced the level . ons . 
of indentation ~~ test_string = “This is a test string” 


The test string won't be 


changed in this code 


However, we can call the 
function like this 
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modify_string(test_string) 
print(test_string) 


test_string = modify_string_return(test_string) 
print(test_string) 


The function’s return value is stored in the variable test string, 
overwriting the original and therefore changing the value that is 
printed. 


[liam@liam-laptop Python]$ ./functions_and_scope. py 
This is a test string 
This is a test string that has been modified. 


Scope is an important thing to get the hang of, otherwise it can get you 
into some bad habits. Let’s write a quick program to demonstrate this. It’s 
going to have a Boolean variable called cont, which will decide if a number 
will be assigned to a variable in an if statement. However, the variable 
hasn’t been defined anywhere apart from in the scope of the if statement. 
We'll finish off by trying to print the variable. 


#!/usr/bin/env python2 
cont = False 
if cont: 

var = 1234 
print(var) 


* 


In the section of code above, Python will convert the integer to a string 
before printing it. However, it’s always a good idea to explicitly convert 
things to strings — especially when it comes to concatenating strings 
together. If you try to use the + operator on a string and an integer, there 
will be an error because it’s not explicitly clear what needs to happen. 
The + operator would usually add two integers together. Having said that, 
Python’s string formatter that we demonstrated earlier is a cleaner way of 
doing that. Can you see the problem? Var has only been defined in the scope 
of the if statement. This means that we get a very nasty error when we try to 
access var. 


[Lliam@liam-laptop Python]$ ./scope.py 
Traceback (most recent call last): 
File “./scope.py”, line 8, in <module> 
print var 

NameError: name ‘var’ is not defined 

If cont is set to True, then the variable will be created and we can access 
it just fine. However, this is a bad way to do things. The correct way is to 
initialise the variable outside of the scope of the if statement. 


#!/usr/bin/env python2 
cont = False 


var = 0 
if cont: 
var = 1234 


if var != @: 
print(var) 


The variable var is defined in a wider scope than the if statement, and 
can still be accessed by the if statement. Any changes made to var inside 
the if statement are changing the variable defined in the larger scope. 
This example doesn’t really do anything useful apart from illustrate the 
potential problem, but the worst-case scenario has gone from the program 
crashing to printing a zero. Even that doesn’t happen because we’ve added 
an extra construct to test the value of var before printing it. 


Coding style 

It’s worth taking a little time to talk about coding style. It’s simple to write 
tidy code. The key is consistency. For example, you should always name 
your variables in the same manner. It doesn’t matter if you want to use 
camelCase or use underscores as we have. One crucial thing is to use 
self-documenting identifiers for variables. You shouldn’t have to guess 


mlat-Kexeyanlante)anere)an) exclatsxe)ane) ol-1e-\ne)ecur-\vc-V1c-1o)(-M lan savin alee uiael Ulo(-s 


what a variable does. The other thing that goes with this is to always 
comment your code. This will help anyone else who reads your code, 
and yourself in the future. It’s also useful to put a brief summary at 
the top of a code file describing what the application does, or a part of 
the application if it’s made up of multiple files. 


Summary 

This article should have introduced you to the basics of programming 
in Python. Hopefully you are getting used to the syntax, indentation 
and general look and feel of a Python program. The next step is 
to learn how to come up with a problem that you want to solve, and 
break it down into small enough steps that you can implement in a 
programming language. 

Google, or any other search engine, is very helpful. If you are stuck 
with anything, or have an error message you can’t work out how to 
fix, stick it into Google and you should be a lot closer to solving your 
problem. For example, if we Google ‘play mp3 file with python’, the 
first link takes us to a Stack Overflow thread with a bunch of useful 
replies. Don’t be afraid to get stuck in — the real fun of programming is 
solving problems one manageable chunk ata time. 


Happy programming! 
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we will look at the core 
essentials that everyone 
needs to know 
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Python has a massive environment of extra modules 
that can provide functionality in hundreds of 
different disciplines. However, every programming 
language has a core set of functionality that everyone 
should know in order to get useful work done. Python 
is no different in this regard. Here, we will look at 
50 commands that we consider to be essential to 
programming in Python. Others may pick a slightly 
different set, but this list contains the best of the best. 

We will cover all of the basic commands, from 
importing extra modules at the beginning of a program 
to returning values to the calling environment at the 
end. We will also be looking at some commands that 
are useful in learning about the current session within 
Python, like the current list of variables that have been 
defined and how memory is being used. 


Because the Python environment involves using a lot 
of extra modules, we will also look at a few commands 
that are strictly outside of Python. We will see how to 
install external modules and how to manage multiple 
environments for different development projects. 
Since this is going to be a list of commands, there is the 
assumption that you already know the basics of how 
to use loops and conditional structures. This piece is 
designed to help you remember commands that you 
know you've seen before, and hopefully introduce you 
toa few that you may not have seen yet. 

Although we've done our best to pack everything 
you could ever need into 50 tips, Python is such an 
expansive language that some commands will have 
been left out. Make some time to learn about the ones 
that we didn’t cover here, once you've mastered these. 


Importing modules 
The strength of Python is its ability to be 
extended through modules. The first step in many 
programs is to import those modules that you need. 
The simplest import statement is to just call ‘import 
modulename’. In this case, those functions and 
objects provided are not in the general namespace. 
You need to call them using the complete name 
(modulename.methodname). You can shorten the 
‘modulename’ part with the command ‘import 
modulename as mn’. You can skip this issue 
completely with the command ‘from modulename 
import *’ to import everything from the given module. 
Then you can call those provided capabilities directly. 
If you only need a few of the provided items, you can 
import them selectively by replacing the ‘**’ with the 
method or object names. 


Reloading modules 

When a module is first imported, any initialisation functions are run at that time. This may involve 
creating data objects, or initiating connections. But, this is only done the first time within a given session. 
Importing the same module again won't re-execute any of the initialisation code. If you want to have this 
code re-run, you need to use the reload command. The format is ‘reload(modulename)’. Something to keep 


in mind is that the dictionary from the previous import isn’t dumped, but only written over. This means that 
any definitions that have changed between the import and the reload are updated correctly. But if you 
delete a definition, the old one will stick around and still be accessible. There may be other side effects, so 


always use with caution. 


While most of the commands we are looking at are Python commands 


that are to be executed within a Python session, there are a few essential 
commands that need to be executed outside of Python. The first of these is pip. 
Installing a module involves downloading the source code, and compiling any included 
external code. Luckily, there is a repository of hundreds of Python modules available 
at http://pypi.python.org. Instead of doing everything manually, you can install a 
new module by using the command ‘pip install modulename’. This command will 
also do a dependency check and install any missing modules before installing the 
one you requested. You may need administrator rights if you want this new module 
installed in the global library for your computer. On a Linux machine, you would 
simply run the pip command with sudo. Otherwise, you can install it to your 
personal library directory by adding the command line option ‘—user’. 


“Every programming language out there has a 
core set of functionality that everyone should 
know in order to get useful work done. Python is 


no different” 


Executing a script 

Importing a module does run the code 
within the module file, but does it through the 
module maintenance code within the Python 
engine. This maintenance code also deals with 
running initialising code. If you only wish to 
take a Python script and execute the raw code 
within the current session, you can use the 
‘execfile(“filename.py”)’ command, where the 
main option is a string containing the Python file 
to load and execute. By default, any definitions 
are loaded into the locals and globals of the 
current session. You can optionally include 
two extra parameters the execfile command. 
These two options are both dictionaries, one 
for a different set of locals and a different set of 
globals. If you only hand in one dictionary, it is 
assumed to be a globals dictionary. The return 
value of this command is None. 


An enhanced shell 

The default interactive shell is provided 

through the command ‘python’, but is 
rather limited. An enhanced shell is provided by 
the command ‘ipython’. It provides a lot of extra 
functionality to the code developer. A thorough 
history system is available, giving you access to 
not only commands from the current session, 
but also from previous sessions. There are also 
magic commands that provide enhanced ways of 
interacting with the current Python session. For 
more complex interactions, you can create and use 
macros. You can also easily peek into the memory 
of the Python session and decompile Python code. 
You can even create profiles that allow you to handle 
initialisation steps that you may need to do every time 
you use iPython. 


Evaluating code 

Sometimes, you may have chunks of 
code that are put together programmatically. If 
these pieces of code are put together as a string, 
you can execute the result with the command 
‘eval(“code_string”). Any syntax errors within 
the code string are reported as exceptions. By 
default, this code is executed within the current 
session, using the current globals and locals 
dictionaries. The ‘eval’ command can also take 
two other optional parameters, where you can 
provide a different set of dictionaries for the 
globals and locals. If there is only one additional 
parameter, then it is assumed to be a globals 
dictionary. You can optionally hand in a code 
object that is created with the compile command 
instead of the code string. The return value of this 
command is None. 
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Asserting values 

At some point, we all need to debug 
some piece of code we are trying to write. One 
of the tools useful in this is the concept of an 
assertion. The assert command takes a Python 
expression and checks to see if it is true. If so, 
then execution continues as normal. If it is not 
true, then an AssertionError is raised. This way, 
you can check to make sure that invariants 
within your code stay invariant. By doing so, 
you can check assumptions made within your 
code. You can optionally include a second 
parameter to the assert command. This second 
parameter is Python expression that is executed 
if the assertion fails. Usually, this is some type of 


Mapping functions 

A common task that is done in modern 

programs is to map a given computation 
to an entire list of elements. Python provides the 
command ‘map()’ to do just this. Map returns a list of 
the results of the function applied to each element of 
an iterable object. Map can actually take more than 
one function and more than one iterable object. If it 
is given more than one function, then a list of tuples 
is returned, with each element of the tuple containing 
the results from each function. If there is more than 
one iterable handed in, then map assumes that the 
functions take more than one input parameter, so 


Virtualenvs 

Because of the potential complexity of 
the Python environment, it is sometimes best to 
set up aclean environment within which to install 
only the modules you need for a given project. In 
this case, you can use the virtualenv command 


to initialise such an environment. If you create 


it will take them from the given iterables. This has 
the implicit assumption that the iterables are all of 
the same size, and that they are all necessary as 
parameters for the given function. 


a directory named ‘ENV’, you can create a new 
environment with the command ‘virtualenv 
ENV’. This will create the subdirectories bin, lib 
and include, and populate them with an initial 
environment. You can then start using this new 
environment by sourcing the script “ENV/bin/ 
activate’, which will change several environment 
variables, such as the PATH. When you are done, 
you can source the script ‘ENV/bin/deactivate’ 
to reset your shell’s environment back to its 
previous condition. In this way, you can have 
environments that only have the modules you 
need for a given set of tasks. 


detailed error message that gets printed out. Or, 
you may want to include cleanup code that tries 
to recover from the failed assertion. 


“While not strictly commands, everyone needs to 
know how to deal with loops. The two main types 
of loops are a fixed number of iterations loop (for) 
and a conditional loop (while)” 


While not strictly commands, everyone needs 

to know how to deal with loops. The two main 
types of loops are a fixed number of iterations loop (for) and 
a conditional loop (while). In a for loop, you iterate over some 
sequence of values, pulling them off the list one at a time 
and putting them in a temporary variable. You continue until 
either you have processed every element or you have hit a 
break command. In a while loop, you continue going through 
the loop as long as some test expression evaluates to True. 
While loops can also be exited early by using the break 
command, you can also skip pieces of code within either 
loop by using a continue command to selectively stop this 
current iteration and move on to the next one. 


Reductions 
In many calculations, one of the 
computations you need to do is a_ reduction 
operation. This is where you take some list of values 
and reduce it down to a single value. In Python, you 
can use the command ‘reduce(function, iterable)’ to 
apply the reduction function to each pair of elements 
in the list. For example, if you apply the summation 
reduction operation to the list of the first five 
integers, you would get the result ((((1+2)+3)+4)+5). 
You can optionally add a third parameter to act as an 
initialisation term. It is loaded before any elements 
from the iterable, and is returned as a default if the 
iterable is actually empty. You can use a lambda 
function as the function parameter to reduce to keep 
your code as tight as possible. In this case, remember 
that it should only take two input parameters. 


Filtering 

Where the command map returns a result for every element in an iterable, filter only returns a 
result if the function returns a True value. This means that you can create a new list of elements where 
only the elements that satisfy some condition are used. As an example, if your function checked that 


the values were numbers between 0 and 10, then it would create a new list with no negative numbers 
and no numbers above 10. This could be accomplished with a for loop, but this method is much 
cleaner. If the function provided to filter is ‘None’, then it is assumed to be the identity function. This 
means that only those elements that evaluate to True are returned as part of the new list. There are 
iterable versions of filter available in the itertools module. 
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File Edit View Search Terminal Help 


~$ python 


Python 2.7.6 (default, Mar 22 2014, 22:59:56) 


[GCC 4.8.2] on Linux2 
Type "help", "copyright", "credits" or 


>>> my_bools = [True, True, False, 
>>> all(my_bools) 

False 

>>> any(my_bools) 

True 

>>> my_List = [0,1,2,3] 


> all(my_list) 
False 
>>> any(my_list) 
True 

> my List2 pra. 
>>> all(my_list2) 
True 
>>> any(my_lList2) 
True 


>>> 


How true is a list? 


"License" for more information. 


False] 


In some cases, you may have collected a number of elements within a list that can be evaluated 
to True or False. For example, maybe you ran a number of possibilities through your computation and 
have created a list of which ones passed. You can use the command ‘any(list)’ to check to see whether 
any of the elements within your list are true. If you need to check whether all of the elements are True, 
you can use the command ‘all(list)’. Both of these commands return a True if the relevant condition is 
satisfied, and a False if not. They do behave differently if the iterable object is empty, however. The 
command ‘all’ returns a True if the iterable is empty, whereas the command ‘any’ returns a False when 


given any empty iterable. 


Sometimes, we need to label the elements 
that reside within an iterable object with their 
indices so that they can be processed at some later 
point. You could do this by explicitly looping through 
each of the elements and building an enumerated 
list. The enumerate command does this in one line. 
It takes an iterable object and creates a list of tuples 
as the result. Each tuple has the 0-based index of 
the element, along with the element itself. You can 
optionally start the indexing from some other value 
by including an optional second parameter. As an 
example, you could enumerate a list of names with 
the command ‘list(enumerate(names, start=1)). In 
this example, we decided to start the indexing at 1 
instead of 0. 


Casting 

Variables in Python don’t have any type 
information, and so can be used to store 
any type of object. The actual data, however, is of 
one type or another. Many operators, like addition, 
assume that the input values are of the same type. 
Very often, the operator you are using is smart 
enough to make the type of conversion that is 
needed. If you have the need to explicitly convert 
your data from one type to another, there are aclass 
of functions that can be used to do this conversion 
process. The ones you are most likely to use is ‘abs’, 
‘bin’, ‘bool’, ‘chr’, ‘complex’, ‘float’, ‘hex’, ‘int’, ‘long’, 
‘oct’, and ‘str’. For the number-based conversion 
functions, there is an order of precedence where 
some types are a subset of others. For example, 
integers are “lower” than floats. When converting 
up, no changes in the ultimate value should happen. 
When converting down, usually some amount of 
information is lost. For example, when converting 
from float to integer, Python truncates the number 
owards zero. 


What is this? 


Everything in Python is an object. You can 
check to see what class this object is an instance 
of with the command ‘isinstance(object, class)’. 
This command returns a Boolean value. 


Is ita subclass? 

The command ‘issubclass(class1, class2)’ 
checks to see if class is a subclass of class2. If 
class and class2 are the same, this is returned 
as True. 


1€1 Ko) of-\ Me) 0} (-Yo4 a) 

You can get a dictionary of the global 
symbol table for the current module with the 
Toreyaavant=Vare mt=4 (0) oF 1010) 


MoYor-| Me) 0) (-1eq k= 

You can access an updated dictionary 
of the current local symbol table by using the 
Coxe) aayaatclare ia (eter | 10a 


Variables 

The command ‘vars(dict)’ returns writeable 
elements for an object. If you use ‘vars()’, it 
behaves like ‘locals()’. 


21) Making a global 


Alist of names can be interpreted as 
globals for the entire code block with the 
command ‘global names’. 


Nonlocals 

In Python 3.X, you can access names from 
the nearest enclosing scope with the command 
a aToyal(oler-\ Marclant-\omr-laren o)[ ace im kon dala (ofer=\ Mcxere) om 


Raising an exception 

A VLaX-YamcelUmCel-Yaldinvaclan-lacelmexe)arelid(olan 
you can use the ‘raise’ command to throw up an 
(-)’Cot-y od fo)apm (LU Kor Lan ialeltb(el-M-lan-y.<ot-yo)a (olan ay] ol-mr- ale] 
EWELIWIce 


24) Dealing with an exception 
Exceptions can be caught in a try-except 

construction. If the code in the try block raises an 
exception, the code in the except block gets run. 


Sy rtd (om palsiaarele ts 


You can create a statis method, similar 
to that in Java or C++, with the command 
‘staticmethod(function_name)’. 
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Ranges 

You may need a list of numbers, maybe in 
a ‘for’ loop. The command ‘range()’ can create an 
iterable list of integers. With one parameter, it 
goes from 0 to the given number. You can provide 
an optional start number, as well as a step size. 
Negative numbers count down. 


Xranges 

One problem with ranges is that all of the 
elements need to be calculated up front and 
stored in memory. The command ‘xrange()’ takes 
the same parameters and provides the same 
result, but only calculates the next element as it 
is needed. 


iterators 

Iteration is a very Pythonic way of doing 
things. For objects which are not intrinsically 
iterable, you can use the command ‘iter(object_ 
name)’ to essentially wrap your object and provide 
an iterable interface for use with other functions 
and operators. 


Sorted lists 


You can use the command ‘sorted(list1)’ 
to sort the elements of a list. You can give it 
a custom comparison function, and for more 
complex elements you can include a key function 
that pulls out a ranking property from each 
element for comparison. 


Summing items 

Above, we saw the general reduction 
function reduce. A specific type of reduction 
operation, summation, is common enough to 
warrant the inclusion of a special case, the 
command ‘sum(iterable_object)’. You can include 
a second parameter here that will provide a 
starting value. 
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With modules 


The ‘with’ command provides the ability to 

wrap a code block with methods defined 
by a context manager. This can help clean up code 
and make it easier to read what a given piece of 
code is supposed to be doing months later. A classic 
example of using ‘with’ is when dealing with files. 
You could use something like ‘with open(“myfile. 
txt’, “r”) as f2. This will open the file and prepare it for 
reading. You can then read the file in the code block 
with ‘data=f.read()’. The best part of doing this is that 
the file will automatically be closed when the code 
block is exited, regardless of the reason. So, even if 
the code block throws an exception, you don’t need to 
worry about closing the file as part of your exception 
handler. If you have a more complicated ‘with’ 
example, you can create a context manager class to 
help out. 


The most direct way of getting output 

to the user is with the print command. 
This will send text out to the console window. If you 
are using version 2.X of Python, there are a couple 
of ways you can use the print command. The most 
common way had been simply call it as ‘print 
“Some text”. You can also use print with the same 
syntax that you would use for any other function. 
So, the above example would look like ‘print(“Some 
text”)’. This is the only form available in version 3.x. 
If you use the function syntax, you can add extra 
parameters that give you finer control over this 
output. For example, you can give the parameter 
‘file=myfile.txt’ and get the output from the print 
command being dumped into the given text file. 
It also will accept any object that has some string 
representation available. 


“A classic example of using ‘with’ is when dealing 
with files. The best part of doing this is that the 
Tile will automatically be closed when the code 
block is exited, regardless of the reason” 


File Edit View Search Terminal Help 
~$ python 


Python 2.7.6 (default, Mar 22 2014, 22:59:56) 


[GCC 4.8.2] on Linux2 
Type “help”, “copyright”, “credits” or 
>>> a = "Hello World’ 
= memoryview(a) 
<memory at 0x7f7994f85938> 
>>> List(b) 
Me PRS IAAT odie Sis ace 
>>> b[5] 


* b[6] 


Memoryview 


"License" for more information. 


Sometimes, you need to access the raw data of some object, usually as a buffer of bytes. You 
can copy this data and put it into a bytearray, for example. But this means that you will be using extra 
ianlelan\elaVAre tale me alicmanll=1a\mareyie ol-we lane) old (olamrelm (gc Ke) 0)|-\eiecrml aleve lanlant-lare iaal-1aalelaVAVi(c\N (e)6)|c\elemmalclant~) 
wraps the object handed in to the command and provides an interface to the raw bytes. It gives access 
to these bytes an element at a time. In many cases, elements are the size of one byte. But, depending 
on the object details, you could end up with elements that are larger than that. You can find out the size 
of an element in bytes with the property ‘itemsize’. Once you have your memory view created, you can 
access the individual elements as you would get elements from a list (mem_viewl'], for example). 


Files 
When dealing with files, you need to create a file object to interact with it. The file command takes 
a string with the file name and location and creates a file object instance. You can then call the file object 
methods like ‘open’, ‘read’ and ‘close’, to get data out of the file. If you are doing file processing, you can 
also use the ‘readline’ method. When opening a file, there is an explicit ‘open()’ command to simplify the 


process. It takes a string with the file name, and an optional parameter that is a string which defines the 
mode. The default is to open the file as read-only (‘r’). You can also open it for writing (‘w’) and appending 
(‘a’). After opening the file, a file object is returned so that you can further interact with it. You can then read 


it, write to it, and finally close it. 


Pickling data 

There are a few different ways of 
serialising memory when you need to checkpoint 
results to disk. One of these is called pickling. 
Pickle is actually a complete module, not just a 
single command. To store data on to the hard 
drive, you can use the dump method to write 
the data out. When you want to reload the same 
data at some other point in the future, you can 
use the load method to read the data in and 
unpickle it. One issue with pickle is its speed, or 
lack of it. There is a second module, cPickle, that 
provides the same basic functionality. But, since 
itis written in C, itcan be as much as 1000 times 
faster. One thing to be aware of is that pickle does 
not store any class information for an object, 
but only its instance information. This means 
that when you unpickle the object, it may have 
different methods and attributes if the class 
definition has changed in the interim. 


In many cases, a function may need to 

yield the context of execution to some other 
function. This is the case with generators. The preferred 
method for a generator is that it will only calculate the 
next value when it is requested through the method 
‘next()’. The command ‘yield’ saves the current state of 
the generator function, and return execution control 
to the calling function. In this way, the saved state of 
the generator is reloaded and the generator picks up 
where it left off in order to calculate the next requested 
value. In this way, you only need to have enough memory 
available to store the bare minimum to calculate the 
next needed value, rather than having to store all of the 
possible values in memory all at once. 


Shelving data 
While pickling allows you save data and 
reload it, sometimes you need more structured 
object permanence in your Python session. With the 
shelve module, you can create an object store where 
essentially anything that can be pickled can be stored 
there. The backend of the storage on the drive can be 
handled by one of several systems, such as dbm or 
gdbm. Once you have opened a shelf, you can read and 
write to it using key value pairs. When you are done, you 
need to be sure to explicitly close the shelf so that it is 
synchronised with the file storage. Because of the way 
the data may be stored in the backing database, it is 
best to not open the relevant files outside of the shelve 
module in Python. You can also open the shelf with 
writeback set to True. If so, you can explicitly call the 
sync method to write out cached changes. 


Weak references 

You sometimes need to have a reference 
to an object, but still be able to destroy it if 
needed. A weak reference is one which can 
be ignored by the garbage collector. If the only 
references left to n object are weak references, 
then the garbage collector is allowed to destroy 
that object and reclaim the space for other 
uses. This is useful in cases where you have 
caches or mappings of large datasets that 
don’t necessarily have to stay in memory. If an 
object that is weakly referenced ends up being 
destroyed and you try to access it, it will appear 
as a None. You can test for this condition and 
then reload the data if you decide that this is a 
necessary step. 


You can do multiple threads of execution 
within Python. The ‘thread()’ command can create a 
new thread of execution for you. It follows the same 
techniques as those for POSIX threads. When you first 
create a thread, you need to hand in a function name, 
along with whatever parameters said function needs. 
One thing to keep in mind is that these threads behave 
just like POSIX threads. This means that almost 
everything is the responsibility of the programmer. You 
need to handle mutex locks (with the methods ‘acquire’ 
and ‘release’), as well as create the original mutexes 
with the method ‘allocate_lock’. When you are done, 
you need to ‘exit’ the thread to ensure that it is properly 
cleaned up and no resources get left behind. You also 
have fine-grained control over the threads, being able 
to set things like the stack size for new threads. 
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File Edit View Search Terminal Help 


Inputting data la 
Sometimes, you need to collect input _internal_num = 
from an end user. The command ‘input()’ can _internal_string = = 


jef 


ake a prompt string to display to the user, and 
hen wait for the user to type a response. Once 
he user is done typing and hits the enter key, the 
ext is returned to your program. If the readline 
module was loaded before calling input, then my_obj = my_class() 
you will have enhanced line editing and history 
functionality. This command passes the text my_obj._internal_num 
hrough eval first, and so may cause uncaught 
errors. If you have any doubts, you can use the 
command ‘raw_input()’ to skip this problem. This 
command simply returns the unchanged string 
inputted by the user. Again, you can use the 
readline module to get enhanced line editing. 


Internal variables 

For people coming from other programming languages, there is a concept of having certain variables 
or methods be only available internally within an object. In Python, there is no such concept. All elements of an 
object are accessible. There is a style rule, however, that can mimic this type of behaviour. Any names that start 
with an underscore are expected to be treated as if they were internal names and to be kept as private to the 
object. They are not hidden, however, and there is no explicit protection for these variables or methods. It is up to 
the programmer to honour the intention from the author the class and not alter any of these internal names. You 
are free to make these types of changes if it becomes necessary, though. 


File Edit View Search Terminal Help 


S python 
Python 2.7.6 (default, Mar 22 2014, 22:59:56) 
[GCC 4.8.2] on Linux2 
Type “help”, "copyright", "credits" or “License” for more information. 
>>> stri = “Hello World" 
= stri 
= "Hello World 


>>> stri == strs 
True 

>>> cmp(stri, str2) 
8 

>>> cmp(stri, str3) 


to] 


>>> stri is str2 
True 

>>> stri is str3 
False 


>>> 


While not truly a command, slices are 
too important a concept not to mention in this 
list of essential commands. Indexing elements 
in data structures, like lists, is one of the most 
common things done in Python. You can select a 


single element by giving a single index value. More 
interestingly, you can select a range of elements by 


giving a start index and an end index, separated by 


Comparing objects acolon. This gets returned as a new list that you can 
There are several ways to compare objects within Python, with several caveats. The first is that save in a new variable name. You can even change 


you can test two things between objects: equality and identity. If you are testing identity, you are testing the step size, allowing you to skip some number of 
to see if two names actually refer to the same instance object. This can be done with the command elements. So, you could grab every odd element from 
‘cmp(obj1, obj2). You can also test this condition by using the ‘is’ keyword. For example, ‘obj1 is obj2’. If the list ‘a’ with the slice ‘a[1::2)’. This starts at index 1, 
you are testing for equality, you are testing to see whether the values in the objects referred to by the continues until the end, and steps through the index 
two names are equal. This test is handled by the operator ‘==’, as in ‘obj1 == obj2’. Testing for equality values 2 at a time. Slices can be given negative index 


can become complex for more complicated objects. values. If you do, then they start from the end of the 
list and count backwards. 
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“Python is an interpreted language, which means 


that the source code that you write needs to be 


compiled into a byte code format. This byte code 


then gets fed into the actual Python engine” 


Edit View Search Terminal Help 

~§ python 
7.6 (default, Mar 22 2014, 22:59:56) 
2] on Linux2 
p 


Python 2. 
[Gcc 4.8 
e 


> 

= 

PL 
1 


Type "h 
>>> sqr 


>>> 


". "copyright", "credits" or "license" for more information. 
Lambda x: x*x 


>>> sqri(10) 
100 
>>> sqri(6) 
> def gen_func(x): 
return Lambda y: y**x 


cubic = gen_func(3) 
> cubic(2) 


Lambda expressions 

Since objects, and the names that point to them, are truly different things, you can have objects 
that have no references to them. One example of this is the lambda expression. With this, you can create 
an anonymous function. This allows you use functional programming techniques within Python. The 
format is the keyword ‘lambda’, followed by a parameter list, then a colon and the function code. For 
example, you could build your own function to square a number with ‘lambda x: x*x’. You can then havea 
function that can programmatically create new functions and return them to the calling code. With this 
capability, you can create function generators to have self-modifying programs. The only limitation is 
that they are limited to a single expression, so you can’t generate very complex functions. 


Compiling 

code objects 

Python is an interpreted 
language, which means that the source 
code that you write needs to be compiled 
into a byte code format. This byte code 
then gets fed into the actual Python engine 
to step through the instructions. Within your program, you may 
have the need to take control over the process of converting 
code to byte code and running the results. Maybe you wish to 
build your own REPL. The command ‘compile()’ takes a string 
object that contains a collection of Python code, and returns 
an object that represents a byte code translation of this code. This 
new object can then be handed in to either ‘eval()’ or ‘exec()’ to be actually 
run. You can use the parameter ‘mode=' to tell compile what kind of code is being 
compiled. The ‘single’ mode is a single statement, ‘eval’ is a single expression and 
‘exec’ is a whole code block. 


__init__ method 

When you create a new class, you can 
fates (Urol-W-W ola Ncclucmlaliutclaccr-Ua(olamant-1aalole Ma arels 
gets called when a new instance of the class is 
created. This method is useful when the new 
object instance needs some data loaded in the 
new object. 


__del__ method 

M \/ar=Yale= Lan al=i -\avex-Mo) 0) {-Yoq al -¥- Lolo] ] miko} ol) 
destroyed, the __del__ method is called. This 
AMV-SMYoLU maT -Mesar-Laler-m mone (oM-TaNva dave me) med (-t- Uae] 0) 
that may be required. This might be closing files, 
or disconnecting network connections. After this 
(efoYe(-Wr-mere)anye)(-n-Lo Mun at-Meole)(-Loum omilarcli\mel-to14eo)"{-V0| 
and resources are freed. 


Exiting your program 

a al-le-w-la- anon ol=s-10 le (oprerelan tant Lae s 
available to exit from the Python interpreter: 
‘exit()’ and quit()’. They both take an optional 
parameter which sets the exit code for the 
process. If you want to exit from a script, you are 
better off using the exit function from the sys 
module (‘sys.exit(exit_code)’. 


Return values 

Functions may need to return some value 
to the calling function. Because essentially no 
name has a type, this includes functions. So 
functions can use the ‘return’ command to return 
FTanvme)o)(-\el mike wat -mer- lt (-1 a 


String concatenation 

We will finish with what most lists start 
with — string concatenation. The easiest way to 
build up strings is to use the ‘+’ operator. If you 
want to include other items, like numbers, you 
can use the ‘str()’ casting function to convert it to 
a string object. 
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26 Code rock, paper, scissors 
iui oy-j(emecorel [ale Miaicek-leld (ola 


32 Program a hangman game 
Use Python to make the classic game 


38 Play poker dice 


MI-\imVelela (Ue e-laremyolulmaelel late} 


44 Create a graphical interface 
PXoloMiaixsvar-la-mcomelelm lee) (14k 


a) 
4 
—) 
” 
= 
— 
77) 
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50 Bring graphics to games 


Add images to simple games 


biom JU CeR-lim-]¢) Miclm-Uilelcel(e| 
Make your own app with Kivy 


CPANEL Cale Bi -) oe] o) os 


Use Python to create online apps 


66 50 Python tips 


Essential knowledge for Python users 


Python ,. 
SaalUels 


“Get to grips with 
mavdarelan-lareRr-lat 
oluiireliaveKeyanaa(= 
basics with these 
expert guides” 


Sd @ 22:44 


Welcome to Linux User & Developers Mega Microgames Collection 


anes She AF che ing games to play: Welcome to Linux User & Developers Mega Microgames Collection. 


Please select one of the following games to play: 


Kock, Paper, Scissors 
Hangman 


Poker Dice 


Hangman 


*Python Shell* 
file Edit Shell Debug Options Windows Help 


tenet 


Game Over. The word was kernel 
Reset 


alatou yatalelaMsiele).ay 2) 


\ 


Allow the Python script 
to runinaterminal, 
and outside the IDE 


Human input in the form 

of integers is used for 
comparing moves and, 
ultimately, playing the game 


Use deduction to 
determine one of 
three outcomes 


Loop the code over 
again and start 
from the beginning 


Append to integer 
variables to keep track 
of scores and more 


Code a game of 
rock, paper, scissors 


Learn how to do some basic Python coding by following 
our breakdown of a simple rock, paper, scissors game 


Resources 


Python 2: www.python.org/download 
IDLE: www.python.org/idle 


26 The Python Book 


This tutorial will guide you through making 
a rock, paper, scissors game in Python. The 
code applies the lessons from the masterclass — 
and expands on what was included there — and 
doesn’t require any extra Python modules to run, 
like Pygame. 

Rock, paper, scissors is the perfect game to 
show off a little more about what exactly Python 
can do. Human input, comparisons, random 
selections and a whole host of loops are used in 
making a working version of the game. It’s also 


easy enough to adapt and expand as you see 
fit, adding rules and results, and even making a 
rudimentary Al if you wish. 

For this particular tutorial, we also 
recommend using IDLE. IDLE is a great Python 
IDE that is easily obtainable in most Linux 
distributions and is available by default on 
Raspbian for Raspberry Pi. It helps you by 
highlighting any problems there might be with 
your code and allows you to easily run it to make 
sure it’s working properly. 


$!/usr/bin/env python2 


# Linux User & Developer presents: Rock, Paper, Scissors: The Video Game 


01 This section imports the extra Python mport random 
functions we'll need for the code - they're SuPees Enee 

still parts of the standard Python libraries, just rock = 1 

not part of the default environment paper = 2 


scissors = 3 


names = { rock: 


0 The initial rules of the game are created 
here. The three variables we're using and 
their relationship is defined. We also provide a 


variable so we can keep score of the games 
deft 


@) We begin the game code by defining the 

start of each round. The end of each play 
session comes back through here, whether we def 
want to play again or not 


@) The game is actually contained all in det 


here, asking for the player input, getting 
the computer input and passing these on to get 
the results. At the end of that, it then asks if you'd | 
like to play again | 


0 Player input is done here. We give the 

player information on how to play this 
particular version of the game and then allow 
their choice to be used in the next step. We also 
have something in place in case they enter an 
invalid option 


0 There are a few things going on when we 

show the results. First, we're putting ina 
delay to add some tension, appending a variable 
to some printed text, and then comparing what 
the player and computer did. Through an if 
statement, we choose what outcome to print, 
and how to update the scores 


O We now ask for text input on whether 
or not someone wants to play again. 

Depending on their response, we go back to the 

start, or end the game and display the results 


if 


start (): 


print “Let's play a game of Rock, 


"Rock", paper: “Paper”, scissors: 
rules = { rock: scissors, paper: rock, scissors: paper } 


player_score = 0 
computer_score = 0 


while game(): 


pass 
scores () 


game (): 


player = move() 

computer = random.randint(1, 3) 
result (player, computer) 

return play_again() 


move (): 


while True: 


print 
player = raw_input (“Rock = 1\nPaper =< 2\nScissors = 3\nMake @ move: *) 


try: 


player = int (player) 
if player in (1,2,3): 


return player 


except ValueError: 
pass 


print "Oops! 


result (player, computer): 
print °1...*% 
time.sleep(1l) 
print °2...° 
time.sleep(1) 
print *3!* 
time.sleep (0.5) 
print “Computer threw (0)}!". format (names[computer])) 
global player_score, computer_score 
if player == computer: 

print “Tie game.* 


else: 


if rules[player] == computer: 


else 


print 


player_score t= 1 


print 


computer_score t= 1 


play_again(): 

answer = raw_input ("Would you like to play again? y/n: 

if answer in ("y", "Y¥", “yes", "Yes", 
return answer 


else: 


I didn't understand that. 


Paper, Scissors.* 


"Your victory has been assured." 


"Of course!"): 


"Scissors" 


* 


} 


Please enter i, 


2 or 3.° 


"The computer laughs as you realise you have been defeated.” 


print "Thank you very much for playing our game. See you next time!" 


scores () 


glebal player_score, computer_score 
print “HIGH SCORES” 

print “Player: ", player_score 
print “Computer: ", computer_score 


—name__ 
start () 


oe | NS | 


The Python Book 27 


The breakdown 
We need to start with the path to the 


0 Python interpreter here. This allows 
us to run the program inside a terminal or 
otherwise outside of a Python-specific IDE 
like IDLE. Note that we’re also using Python 2 
rather than Python 3 for this particular script, 
which needs to be specified in the code to 
make sure it calls upon the correct version 
from the system. 


01 


#!/usr/bin/env python2 


# Linux User & Developer presents: 


random 
time 


import 
import 


rock 
paper = 
scissors 


rock: 


"Rock*,, 


0 We're importing two extra modules on 

top of the standard Python code so 
we can use some extra functions throughout 
the code. We'll use the random module to 
determine what move the computer will throw, 
and the time module to pause the running of 
the code at key points. The time module can 
also be used to utilise dates and times, either 
to display them or otherwise. 


Rock, 


paper: "Paper", scissors: 


0 We're setting each move to a specific 

number so that once a selection is 
made by the player during the game, it will be 
equated to that specific variable. This makes 
the code slightly easier later on, as we won't 
need to parse any text for this particular 
function. If you so wish, you can add additional 
moves, and this will start here. 


Paper, Scissors: The Video Game| 


"Scissors" 


} 


pulse = { rock: scissors, paper: rock, scissors: paper +} 


player_score 
computer_score 


0 Here we specify the rules for the game, 

and the text representations of each 
move for the rest of the code. When called upon, 
our script will print the names of any of the three 
moves, mainly to tell the player how the computer 
moved. These names are only equated to these 
variables when they are needed — this way, the 
number assigned to each of them is maintained 
while it’s needed. 


Python modules 


There are other modules you can import with 
basic Python. Some of the major ones are 
shown to the right. There are also many more 
that are included as standard with Python. 
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0 Similar to the way the text names of 

thevariables are defined and used only 
when needed, the rules are done in such a way 
that when comparing the results, our variables 
are momentarily modified. Further down in the 
code we'll explain properly what’s happening, 
but basically after determining whether or 
not there’s a tie, we'll see if the computer’s 
move would have lost to the player move. If the 
computer move equals the losing throw to the 
player’s move, you win. 


O06 Very simply, this creates a variable that 
can be used throughout the code to 
keep track of scores. We need to start it at zero 
now so that it exists, otherwise if we defined 
it in a function, it would only exist inside that 
function. The code adds a point to the computer 
or player depending on the outcome of the round, 
although we have no scoring for tied games in 
this particular version. 


|string Perform common string operations 
| datetime and calendar | Other modules related to time 


ee Advanced ma atical functions 
——<$<— Documentation generator and online help system 


O Here we define the actual beginning of the code, with the function 

we've called ‘start’. It’s quite simple, printing our greeting to the 
player and then starting a while loop that will allow us to keep playing the 
game as many times as we wish. The pass statement allows the while loop 
to stop once we've finished, and could be used to perform anumber of other 
tasks if so wished. If we do stop playing the game, the score function is then 
called upon — we'll go over what that does when we get to it. 


0 We've kept the game function fairly simple so we can break down 
each step abit more easily in the code. This is called upon from the 
start function, and first of all determines the player move by calling upon 
the move function below. Once that’s sorted, it sets the computer move. It 
uses the random module’s randint function to get an integer between one 
and three (1, 3). It then passes the player and computer move, stored as 
integers, onto the result function which we use to find the outcome. 


move () 
computer = random.randint(l, 3) 
result (player, computer) 

play_again() 


retur! 


def move(): 
while True: 
print 
player = raw_input ("Rock = 1\nPaper = 2\nScissors = nMake a move ") 


player = int (player) 
if player in (1,2,3): 
return player 


except ValueErro 
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file Edit Shell Debug Options Windows Help 


Python 2.7.3 (default, Sep 26 2012, 21:51:14) 
{ccc 4.7.2] on linux2 

type “copyright", “credits” or cense()" for m 
2??? == RESTART 


Let's 


play a game of Rock, 


move: 5 
I didn't 


understand that. 


MM ac=Kevore(-¥iak-ead(e) a) 


0 We start the move function off by putting it into 

a while loop. The whole point of move is to obtain 
an integer between one and three from the player, so the 
while loop allows us to account for the player making an 
unsupported entry. Next, we are setting the player variable 
to be created from the player’s input with raw_input. We've 
also printed instruction text to go along with it. The ‘\n’ we've 
used in the text adds a line break; this way, the instructions 
appear as a list. 


1 0 The try statement is used to clean up code and 

handle errors or other exceptions. We parse what the 
player entered by turning it into an integer using int(). We use 
the if statement to check if itis either 1, 2, or 3 — if itis, move 
returns this value back up to the game function. If it throws 
up a ValueError, we use except to do nothing. It prints an error 
message and the while loop starts again. This will happen 
until an acceptable move is made. 
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a 


Theresultfunction onlytakesthevariables 


1 player and computer for this task, which is 
why we set that in result(player, computer). We're 
starting off by having a countdown to the result. 
The printed numbers are self-explanatory, but 
we've also thrown in sleep from the time module 
we imported. Sleep pauses the execution of the 


result (player, 


BEING Whines” 
time.sleep (1) 
Brin’: "2ss<" 


time.sleep(1) 


print 


time.sleep(0.5) 


computer): 


code by the number of seconds in the brackets. 
We've put a one-second pause between counts, 
then half a second after that to show the results. 
1 2 To print out what the computer threw, 
we're using string.format(). The {0} in the 
printed text is where we're inserting the move, 


which we have previously defined as numbers. 
Using names[computer], we're telling the code to 


rules[player] 
print *Y 


tour 


1 The way we're checking the result is 

basically through a process of elimination. 
Our first check is to see if the move the player 
and computer used were the same, which is the 
simplest part. We put it in an if statement so that 
if it’s true, this particular section of the code ends 
here. It then prints our tie message and goes back 


tothe game function for the next step. 
Ifit’s nota tie, we need to keep checking, 


1 5 as it could still be a win or a loss. Within 
the else, we start another if statement. Here, 
we use the rules list from earlier to see if the 
losing move to the player’s move is the same 
as the computer’s. If that’s the case, we print 
the message saying so, and add one to the 
player_score variable from before. 
1 6 If we get to this point, the player has lost. 
We print the losing message, give the 


computer a point and it immediately ends the 
result function, returning to the game function. 
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player score t= 


VICLO 


look up what the text version of the moveis called 
from the names we set earlier on, and then to 


insert that where {0} is. 

1 3 Here we're simply calling the scores we 
set earlier. Using the global function 

allows for the variable to be changed and used 

outside of the variable, especially after we’ve 

appended a number to one of their scores. 
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File Edit Shell Debug Options Windows Help 


Python 2.7.3 
{Gcc 4.7.2] 


(default, 
on linux2 


3! 
Computer threw Rock! 
Tie game. 


Sep 26 2012, 


isSis 


2 
Zi 


14) 


Type “copyright", “credits” or "“license()" for more information. 
>>> seeeeemeneneeseeeseeeeseeesee=== RESTART ==seeeenseeseneseesessse= 
>>> 

Let's play a game of Rock, Paper, issors 

Rock = 1 

Paper = 2 

Scisseurs = 3 

Make a move: 5 

Oops! I didn't understand that. Please enter 1, 2 or 3 

Rock - 1 

Paper = 2 

Ss sors = 3 


MW at=Kexere(-¥ lan \e14(e) a) 


1 The next section of game calls upon 

a play_again function. Like the move 
function, we have human input, asking the player 
if they would like to play again via a text message 
with raw_input, with the simple ‘y/n’ suggestion in 
an attempt to elicit an expected response. 


‘wi : 
jet play_again(): 


raw_input ("Would you like 


answer = 


1 Ss Giving users an option of y/n like we have 

should expect a response in kind. The 
if statement checks to see if any of our defined 
positive responses have been entered. As Python 
doesn't differentiate between upper or lower 
case, we've made sure that it accepts both y and 
Y. If this is the case, it returns a positive response 
to game, which will start it again. 


1 9 If we don’t get an expected response, we 

will assume the player does not want to 
play again. We'll print a goodbye message, and 
that will end this function. This will also cause 
the game function to move onto the next section 
and not restart. 


scores(): 
player_score, 


"HIGH SCORES" 


computer_score 


player_score 


, 


computer_score 


Python Shel 


[ile Edit Shell Debug Options Windows Llelp 


Python 2.7.3 (default, Sep 26 2012, 21:51:14) 
(Gcc 4.7.2] on linux2 
Type “copyright”, "credits" or "license()" for more information. 
>>> SSS SSS SSS SSS SSS SSS SSS SSS SS SSS SSS RESITARI SSeS Se eS Se Se Se See Se SS SS SS SS Se SSeS 
Let's play a game of Rock, Paper, Scissors 
Rock - 
Paper = 2 
Scissors = 3 
Make a move: 5 
Oops! I didn’t understand that. Please enter 1, 2 or 3. 
Kock = 1 
Paper = ? 
Scissors - 3 
Make a move: 1 
threw Rock! 
Would you like to play again? y/n: n 


thank you very much 
HTGH SCORFS 

Player: 0 
Computer: 0 


for playing our game. 


MM at-Kevore(-¥lak-(eut(e)a) 


ELIF 


IFalsohasthe ELIF (elseif) operator, whichcan 
be used in place of the second IF statement 
we employed. It’s usually used to keep code 
clean, but performs the same function. 
2 Going back to the start function, after 
game finishes we move onto the results. 
This section calls the scores, which are integers, 
and then prints them individually after the names 
of the players. This is the end of the script, as far 
as the player is concerned. Currently, the code 
won't permanently save the scores, but you can 
have Python write it to a file to keep if you wish. 
2 The final part allows for the script to 
be used in two ways. Firstly, we can 
execute it in the command line and it will work 
fine. Secondly, we can import this into another 


Python script, perhaps if you wanted to add it as 
a game to acollection. This way, it won't execute 


the code when being imported. 
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NY 


This section imports the extra Python 
functions we'll need for the code — 
they’re still parts of the standard 
Python libraries, just not part of the 
default environment 


We're again providing variables so we 
can keep score of the games played, 
and they’re updated each round 


Our very basic graphics involve ASCII 
art of the game’s stages, printed out 
after every turn 


Programa 
ame of 
angman 


Learn how to do some more Python 
coding by following our breakdown of a 
simple Hangman game 


Resources 


Python 2: www.python.org/download 
IDLE: www.python.org/idle 
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One of the best ways to get to know Python is 
by building lots of simple projects so you can 
understand a bit more about the programming 
language. This time round, we're looking at 
Hangman, a multi-round game relying on if 
and while loops and dealing with strings of text 
in multiple ways. We'll be using some of the 
techniques we implemented last time as well, so 
we can build upon them. 

Hangman still doesn’t require the Pygame 
set of modules, but it’s a little more advanced 


Code listing 


#!/usr/bin/env python2 


from random import * 


’ player_score = @ 
computer_score = Q 


graphic = 
aon 
+------- + 
con 
, 
con 
+------- + 
| 
0 
99 
, 
7 
99 
, 
99 
+------- + 
| | 
| 0 
| i? 
| /% 
| 


print graphic[hangman] 
return 


than  rock-paper-scissors. We're _ playing 
around with a lot more variables this time. 
However, we're still looking at comparisons, 
random selections and human input, along 
with splitting up a string, editing a list and even 
displaying rudimentary graphics. 

You should continue to use IDLE for these 
tutorials. As we’ve mentioned before, its built- 
in debugging tools are simple yet effective and 
it can be used on any Linux system, as well as 
the Raspberry Pi. 


The actual game starts here, with a while loop to 
let you continually play the game until you decide 
otherwise, then ending the program 


The game rules are decided here, as well as the 
setup for the word and keeping track of tries and 
incorrect answers 


Each round of the game is played here, asking for 
an input, then telling you if you were correct or not. 
It prints out the graphic and changes any variables 
that need to be updated, especially incorrect and 
correct guesses 


After each round, the code checks if you’ve won or 
lost yet — the win condition being that you guessed 
the word, or losing if you’ve made six guesses 


The human input for the game takes the letter 
and turns it into something the code can use. It’s 
verified in the previous block of code and then 
referred back to if you’ve entered an unsupported 
or already used character 


The same class as last time, which allows you to 
select whether or not you wish to play again 


Upon quitting the game, scores are given for the 
duration of the play session. We also end the script 
with the if ___name__code like before 


fe) Code highlighting 


IDLE automatically highlights the code to make 
reading your work that bit easier. It also allows 
you to change these colours and highlighting in 
IDLE’s Preferences, in case you’re colour blind 
or are just used to a different colour scheme 
in general. 


g Ub 


f 


1 


[der start(): 


def 


def 


def 


def 


Code listing continued 


print “Let’s play a game of Linux Hangman.” 
while game(): 

pass 

scores() 


game(): 

dictionary = [“gnu”,”kernel”,”linux”,”mageia”,”penguin”,”ubuntu”’] 
word = choice(dictionary) 

word_length = len(word) 

clue = word_length * [‘“_”] 

tries = 6 

letters_tried = “” 

guesses = @ 
letters_right = 0 
letters_wrong = @ 

global computer_score, player_score 


while (letters_wrong != tries) and (“”.join(clue) != word): 
letter=guess_letter() 
if len(letter)==1 and letter.isalpha(): 
if letters_tried.find(letter) != -1: 
print “You’ve already picked”, letter 
else: 
letters_tried = letters_tried + letter 
first_index=word.find(letter) 
if first_index == -1: 
letters_wrong +=1 
print “Sorry,”,letter,”isn’t what we’re looking for.” 
else: 
print”Congratulations,”,letter,”is correct.” 
for i in range(word_length): 
if letter == word[il: 
clue[i] = letter 
else: 
print “Choose another.” 


hangedman(letters_wrong) 
print “ “.join(clue) 
print “Guesses: “, letters_tried 


if letters_wrong == tries: 
print “Game Over.” 
print “The word was”,word 
computer_score += 1 
break 

if “’.join(clue) == word: 
print “You Win!” 
print “The word was”,word 
player_score += 1 
break 

return play_again() 


guess_letter(): 

print 

letter = raw_input(“Take a guess at our mystery word:”) 
letter.strip() 

letter. lower() 

print 

return letter 


play_again(): 
answer = raw_input(“Would you like to play again? y/n: “) 
if answer in (“y”, “Y”’, “yes”, “Yes”, “Of course!”): 
return answer 
else: 
print “Thank you very much for playing our game. See you next time!” 


scores(): 

global player_score, computer_score 
print “HIGH SCORES” 

print “Player: “, player_score 
print “Computer: “, computer_score 


if __name__ == ‘__main__’: 
startQ) 
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\ 


| see ASCII 


Here’s a close-up of the seven 
stages we've used for Hangman’s 
graphics. You can change them 
yourself, but you need to make 
sure the quote marks are all in 
the correct place so that the art 
is considered a text string to be 
printed out. 


4+------- + 
| 
| 
| 
| 
| 
im 
, 
conn 
4+------- + 
| | 
| 0 
| 
| 
| 
= Saeesseeoeene 
, 
conn 
4+------- + 


4+------- + 
| 0 
| = 
| 
| 
| 
Sop eeae 
, 
conn 
4+------- + 
| | 
| 0 
| #e 
| 
| 
-_.. 
, 
mn 
4+------- + 
| 
0 
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or) #!/usr/bin/env python2 


GY fron random import * 
GE Plaver_score = Q 
computer_score = Q 


def hangedman(hangman): 
graphic = [ 


669999 


669999 


669999 


GE ccf startQ): 


fe) The rules 


Although we’ve moved some of 
the rules to the ‘game’ function 
this month, you can always put 
them back here and call upon 
them using the global variable, as 
we would do with the scores. For 
the words, you could also create a 
separate file and import them like 
the random module. 


print “Let’s play a game of Linux Hangman.” 


while game(): 
pass 
scores() 


0 We begin by using this line to enter the path 

to the Python interpreter. This allows us to 
run the program inside a terminal or otherwise outside 
of a Python-specific IDE like IDLE. Note that we're 
also using Python 2 for this particular script, as it is 
installed by default on most Linux systems and will 
therefore ensure compatibility. 


0 We're importing the ‘random’ module slightly 
differently this time, importing the actual 
names of the functions from random rather than just 
the module itself. This allows us to use the functions 
without having syntax like random.function. The 
asterisk imports all the functions from random, 
although you can switch that for specific names of 
any of random’s functions. We'll be using the random 
function to select a word for the player to guess. 


03 Very simply, this creates a variable that can 
be used throughout the code to keep track 
of scores. We need to start it at zero now so that it 
exists; otherwise if we defined it in a function, it would 


only exist inside that function. The code adds a point 
to the computer or player depending on the outcome 
of the round. 


O04 Our simple graphics consist of a series of 
ASCIl hanging man stages. We’re storing 


these in a function as a list of separate string objects 
so we can call upon them by passing on the number of 
incorrect guesses to it. There are seven graphics in all, 
like in the pen-and-paper version. We also include the 
print command with the function, so when it’s called it 
will completely handle the selection and display of the 
hanging man, with the first one being printed after the 
first letter is guessed. 


05 Here we define the actual beginning of the 
code, with the function we've called ‘start’. 


It’s quite simple, printing our greeting to the player 
and then starting a while loop that will allow us to keep 
playing the game as many times as we wish. The pass 
statement allows the while loop to stop once we’ve 
finished, and could be used to perform a number 


oe) def game(): 


dictionary = 


word = choice(dictionary) 


word_length = len(word) 


clue = word_length * [“_”] 


oa) tries = 6 


letters_tried = “” 
guesses = @ 

letters_right = @ 
letters_wrong = @ 


global computer_score, player_score 


oo) while (letters_wrong != tries) and (“’.join(clue) != word): 


letter=guess_letter() 
if len(letter)==1 and letter.isalphaQ: 
if letters_tried.find(letter) != -1: 
print “You’ve already picked”, letter 


of other tasks if so wished. If we do stop playing the 
game, the score function is then called upon —we'll go 
over what that does when we get to it. 


O06 We have put a majority of the game code 
in the ‘game’ function this time around, as 


there’s not as much that needs to be split up. You can 
split it up further if you wish, using the style of code 
from last issue, if it would make the code cleaner 
for you or help you understand the building blocks a 


bit more. 
0 The first four lines quickly set up the word 
for the player to guess. We've got a small 
selection of words in a list here. However, these can be 
imported via HTML or expanded upon. Choice is used 
to select a random element from the list, which comes 
from the random module we imported. Finally, we 
ascertain how long the string is of the word to guess, 
and then create the clue variable with a number of 
underscores of that length. This is used to display the 
word as you build it up from guesses. 
8) We start to set up the rules and the individual 
variables to keep track of during the game. 
There can only be six incorrect guesses before the 
hanging man is fully drawn, or in our case displayed, 
so we set the tries variable to six. We'll keep track of 


the letters through letters_tried to make sure that not 
only will the player know, but also the code for when 


it’s checking against letters already played. Finally, 
we create empty variables for the number of guesses 
made, letters correct and letters incorrect, to make 
the code slightly easier. We also import the global 


scores here. 
0 We're starting a while loop to perform the 
player selection and check the status of the 
game. This loop continues until the player wins or loses. 
It starts by checking if all the tries have been used up 
by seeing if letters_wrong is not equal to tries. As each 
try will only add one point to wrong, it will never go 
above six. It then concatenates ‘clue’ and sees if it’s the 
same as the word the computer selected. If both these 
statements are true, it goes on to the next turn. 


1 We call upon the function we're using to 

input a letter and give it the variable ‘letter’. 
We check what it returns by first of all making sure 
it’s only a single letter, with len(letter), then by 
using isalpha to see if it’s one of the 26 letters of the 
alphabet. If these conditions are satisfied, we start 
a new if statement to make sure it’s a new guess, 
and tell the player if it’s already been chosen so they 
can start again. If all this is acceptable, we move on 
to the next section of the code to see if it’s a correct 
guess or not. 


/ 


[“gnu”,”kernel”,” linux”,”mageia”,”penguin”,” ubuntu” ] @ 


Q| Take (=yale= tice) ats 


While IDLE will keep track of the 
indents in the code, if you’re using 
atext editorto write some Python, 
you'll have to make sure you’re 
using them correctly. Python is 
very sensitive to whether or not 
indents are used correctly, and it 
does aid in readability as well. 


TS CS 


i: 
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fe) Continuation 


This code is still part of the 
game function we started on the 
previous page, so make sure your 
indentations are in alignment if 
you’re not using an IDE. If you plan 
to split this code up, we’d suggest 
starting with the word selection 
and results. 


Gi else: 
letters_tried = letters_tried + letter 
first_index=word.find(letter) 


if first_index == -1: 
letters_wrong +=1 


print “Sorry,”,letter,”isn’t what we’re looking for.” 


else: 


print”Congratulations,”, letter,” is correct.” (B 


for i in range(word_length): 
if letter == word[i]: 
clue[i] = letter 


else: 
print “Choose another.” 


hangedman(letters_wrong) 
print “ “.join(clue) 
print “Guesses: “, letters_tried 


if letters_wrong == tries: 
print “Game Over.” 
print “The word was”,word 
computer_score += 1 
break 

if “’.join(clue) == word: 
print “You Win!” 
print “The word was”,word 
player_score += 1 
break 


return play_againQ 


—_a 


1 1 If it’s a new letter that we find acceptable, 
the first thing we do is add it to the list 
of letters tried. This is done simply by adding 
the strings together. We then use the find 
command to search the word string for the letter 
entered, which will then return a number of the 
placement of the letter in the string. If it doesn’t 
find the letter, it returns a -1 value, which we use 
in the next if statement to see if the first_index 
variable is -1. If so, tt adds one to the number of 
letters_wrong and then prints a message to let 
the player know that it was an incorrect guess. 


1 2 If we've got this far and the letter is not 
incorrect, than we can only assume 
it is correct. Through this simple process of 
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elimination, we first print out a message to let 
the player know that they've been successful and 
then make arecord of it. 


1 We're going to start a small loop here so 

we can update the clue with the correct 
letter we've added. We use the range function to 
tell the code how many times we wish to iterate 
over the clue by using the word_length variable. 
We then check to see which letter in the word 
has been guessed correctly and change that 
specific part of the clue to be that letter so it can 
be printed out for the player to see, and for us to 
check whether or not the game is over. 


1 We end the original if statement by telling 

the player to choose again if they did not 
enter a supported input. Before we go on to the 
next round of choices, we print out the hanging 


man graphic as it stands, by calling the graphic 
in the list that corresponds to the number of 
incorrect guesses that have been made. We then 
print how the clue currently looks, with a space 
in between each character, and then print the 
number of guesses that have been made. 


1 5 Here we check to see if the game is 

over again, first of all comparing the 
letters_wrong to the number of tries. If that’s 
true, we print a message that the game has 
ended and reveal the mystery of the hidden word. 
We increase the computer's score and break the 
loop. The next loop checks to see if the full clue 
concatenated is the same as the original word — if 
that’s the case, we print the win message, the full 
word and add one point to the player score before 
breaking the loop again. This can also be done 
with ifs and elifs to avoid using breaks. 


n7 def guess_letter(): 
print 


letter = raw_input(“Take a guess at our mystery word:’) 


letter.stripQ 
letter. lower() 
print 

return letter 


play_againQ): 


‘| if answer in (“y”, 


return answer 


eo} else: 


scores(): 


print “HIGH SCORES” 
print “Player: 
print “Computer: “, 


2) if __name__ == 


startQ) 


1 We end the entire game function loop by 

calling upon return again, which we will 
then pass all the way up to the start function once 
it’s finished. 


1 The human input function first of 

all prints out a raw_input message. 
Once the player enters the letter, the function 
parses it to be used with the rest of the code. 
Firstly, strip is used to remove any white space 
from the input given, as we've not given it any 
extra parameters. We then convert it into 
lower-case letters, as Python will not be able 
to correctly compare an upper-case character 
with a lower-case alternative. We then print the 
selection for the record and return it up to the 
game function. 


1 g The last part of the game function is to 

ask the player if they wish to try again. 
The play_again function takes a human input 
with a simple message and then analyses the 
input so it knows what to send back. 


ceo? 
? 


global player_score, 


«__main 


“ves”, “Yes”, 


computer_score 


“ player_score 


computer_score 


a. 


1 Giving users an option of y/n like we 
have should expect a response in kind. 
The if statement checks to see if any of our 
defined positive responses have been entered. 
As Python doesn't differentiate between upper 
or lower case, we've made sure it accepts both 
y and Y. If this is the case, it returns a positive 
response to game, which will start it again. 


20 If we don’t get an expected response, 
we will assume the player does 
not want to play again. We'll print a goodbye 
message and that will end this function. This 


will also cause the start function to move onto 
the next section and not restart. 


2 Going all the way back to the start 
function, after game finishes we move 
onto the results. This section is quite simple — 
calls the scores, which are integers, and then 
prints them individually after the names of the 
players. This is the end of the script, as far as 
the player is concerned. Currently, the code will 


answer = raw_input(“Would you like to play again? y/n: “) 
“Of course!”): 


print “Thank you very much for playing our game. See you next time!” 


e) Homework 


Now that you’ve finished with the code, why 
not make your own changes? Increase the 
word count; create different, selectable word 
categories; or even let people guess the full 
word. You have all the tools to do this in the 
current code and last month’s tutorial. 


not permanently save the scores, but you can 
have Python write it to a file to keep if you wish. 


22 The final part of the code allows for 
the script to be used in two ways. 


Firstly, we can execute it in the command line 
and it will work fine. Secondly, we can import 
this into another Python script, perhaps if 
you wanted to add it as a game to a collection. 
This way, it will not execute the code when 


being imported. 


li 


The Python Book 37 


NX 


Play poker dice using Python 


Put on your poker face and get ready to gamble as you hone 
your programming skill with a bit of poker dice 


Resources 


Python 2: www.python.org/download 
IDLE: www.python.org/idle 


The Start 

Here we’re doing some minor setups so we can 
get our code to run with some extra modules not 
included with the basics 


So you've learnt how to program tic-tac-toe 
and guessed your way to victory at hangman. 
Now it’s time to head to Las Vegas and play our 
cards right. Or in this case, virtual dice, and more 
like Reno as we continue with our Python game 
tutorials and introduce you to some poker dice. 
We're again using some of the lessons we've 
already learnt, including random number 
generation, list creation and modification, 
human input, rule setting, scoring and more. 
But we'll also be adding some new skills in this 


import random 


#!/usr/bin/env python2 


The Rules 
We’re setting names for each dice roll so they can 
be properly identified to the player —- much more 


interesting than numbers f 


The Score 
Again we’ve got some basic variables set up so we 


can keep score of the games if we want to Z 


The Script 

The game is handled here, passing the player onto 
the next function to actually play, and handling the 
end of the session as well 


The Game 
We access the full game loop via here, and the 
function that allows us to play again if we’re 
so inclined 


The Throw 

The initial hand is dealt, so to speak, at the start of 
the throws function. This function handles all the 
decision making in the game, while passing off the 
dice rolls to another function 


from itertools import groupby 


nine = 1 
ten = 2 
jack = 3 
queen = 4 
king = 5 
ace = 6 


names = { nine: “9”, ten: “10”, 


player_score = @ 
computer_score = 0 


def start): 


while game(): 
pass 
scores() 


def game(): 


throws() 
return play_again() 


def throws(): 
roll_number = 5 
dice = roll(roll_number) 
dice.sort() 
for i in range(len(dice)): 


The Hand 
We've also got a special function so we can inform 
the player exactly what style of hand they have 


[result = hand(ice) 
print “You currently have”, 


while True: 


The Decision 
There are two rounds in this version of poker 
dice, and you can select how many dice you wish 
to re-roll in this small while loop that makes sure 
you’re also using a correct number 
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try: 


break 
except ValueError: 
pass 


jack: “J”, queen: 


if rerolls in (1,2,3,4,5): 


tutorial. Namely, we'll be creating and appending 
lists with random numbers, and using functions 
multiple times in one block of code to cut down 
on bloat. 

Again, we recommend using IDLE, and we're 
using Python 2 to ensure compatibility with a 
wider variety of distros, including the Raspberry 
Pi. So, we hope luck is a lady for you and that the 
odds are ever in your favour — just keep those 
fingers crossed that you don’t roll a snake eyes 
(we are coding in Python, after all)! 


Code listing 


“Q”, king: “K”, ace: “A” } 


— print “Let’s play a game of Linux Poker Dice.” 


print “The computer will help you throw your 5 dice” 


iss print “Dice”,i + 1,”:”,names[dice[i]] 


result 


rerolls = input(“How many dice do you want to throw again? “) 


= print “Oops! I didn’t understand that. Please enter 1, 2, 3, 4 or 5.” 


The Re-roll 

We’re doing the second set of rolls and starting 
the end of the game here by calling on the same 
function as before, but we’re also aware that 
choosing no re-rolls means the end of the game 


+ 


The Dice 
Here we’re finding out which dice the player wants 
to re-roll, and also making sure that they enter 
a valid number. Just so they know they’re doing 
something, we print something after every turn 


Second Hand 

We change and display the new dice hand to end 
the game. Again, we make sure to tell the player 
what the actual hand they have is 


The Rolls 


The function we reuse to roll our virtual six dice 


if 


Vf 


using a simple while loop. This allows us to keep def 
the codebase smaller 


The Analysis 

There are eight possible types of hands in poker 
dice, and we can use a bit of logic to work out all 
but one of them without checking against all 7,776 
outcomes -— in fact, we only specifically have to 
check for two 


def 


The Question 
Our simple ‘play again’ function that parses player 
input so we can restart or end the script 


The End 

Scores are displayed at the end of the script, and 
the very final part allows us to import this into 
other Python scripts as a module 


Q FarNaUitenen 


Splitting up actions into functions 
makes it easier to not only perform 
them multiple times, but reduce 
the amount of code. On larger 
projects, this can aid with speed. 


def 


if _ 


if rerolls == 0: Code listing continued 


print “You finish with”, result 
else: 
roll_number = rerolls 
dice_rerolls = roll(roll_number) 
dice_changes = range(rerolls) 
print “Enter the number of a dice to reroll: “ 
iterations = 0 
while iterations < rerolls: 
iterations = iterations + 1 
while True: 
selection = input(“”) 
try: 
if selection in (1,2,3,4,5): 
break 
except ValueError: 
pass 
print “Oops! I didn’t understand that. Please enter 1, 2, 3, 4 or 5.” 
dice_changes[iterations-1] = selection-1 
print “You have changed dice”, selection 


iterations = 0 

while iterations < rerolls: 
iterations = iterations + 1 
replacement = dice_rerolls[iterations-1] 
dice[dice_changes[iterations-1]] = replacement 


dice.sort() 
for i in range(len@ice)): 
print “Dice”,i + 1,”:”,names[dice[i]] 


result = hand(dice) 
print “You finish with”, result 


roll(roll_number): 

numbers = range(1,7) 

dice = range(roll_number) 

iterations = Q 

while iterations < roll_number: 
iterations = iterations + 1 
dice[iterations-1] = random.choice(numbers) 

return dice 


hand(dice): 

dice_hand = [len(list(group)) for key, group in groupby(dice)] 
dice_hand.sort(reverse=True) 

straight1 = [1,2,3,4,5] 

straight2 = [2,3,4,5,6] 


if dice == straight1l or dice == straight2: 
return “a straight!” 
elif dice_hand[@] == 5: 
return “five of a kind!” 
elif dice_hand[@] == 4: 
return “four of a kind!” 
elif dice_hand[@] == 3: 
if dice_hand[1] == 2: 
return “a full house!” 
else: 
return “three of a kind.” 
elif dice_hand[@] == 2: 
if dice_hand[1] == 2: 
return “two pair.” 
else: 
return “one pair.” 


else: 
return “a high card.” 


play_again(): 
answer = raw_input(“Would you like to play again? y/n: “) 
if answer in (“y”, “Y”, “yes”, “Yes”, “Of course!”): 
return answer 
else: 
print “Thank you very much for playing our game. See you next time!” 


scores(): 
global player_score, computer_score 
print “HIGH SCORES” 


print “Player: “, player_score 
print “Computer: “, computer_score 
_name__ == ‘__main__’: 

start() 
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‘orf #!/usr/bin/env python2 


oz import random 
from itertools import groupby 


os nine = 1 
ten = 2 


jack = 3 
queen = 4 
king = 5 
ace = 6 


names = { nine: “9”, ten: “10”, jack: “J”, queen: “Q”, king: “K”, ace: 


player_score = @ 


af computer_score 


@ 


def startQ: 


print “Let’s play a game of Linux Poker Dice.” 


while game(): 
pass 
scores() 


oe def game(): 
print “The computer will help you throw your 5 dice” 


throws() 
return play_again() 


01 Begin 

As before, we use this line to enter the 
path to the Python interpreter. This allows us to 
run the program inside a terminal or otherwise 
outside of a Python-specific IDE like IDLE. Note 
that we're also using Python 2 for this script. 


02 Importing 
As well as importing the random module 


for our dice throws, we need to get the groupby 
function so we can order the dice in a way that is 
more readable and also easier for analysis when 
telling the player what hand they have. 


'@) Cards 

While we're using random numbers for 
the dice rolls, unless we assign the correct cards 
to each number, the player won't know what 
they've rolled and what constitutes a better 
hand. We set each card to a number and then 
equate what these should be printed out as. 


'@) Scores 
As usual, we have the empty scores 
for the player and computer so we can update 
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these as we go. While it’s not specifically used 
in this version of the code, it’s easy enough 
to expand on it and add your own simple 
computer roll, or limited Al for both rolls. 


@) Start 

We’re starting the interactive part of the 
code with the ‘start’ function. It prints a greeting 
to the player, then starts a while loop that'll allow 
us to replay the game as many times as we wish. 
The pass statement allows the while loop to stop 
once we've finished. If we do stop playing the 
game, the score function is then called upon. 


06 in: 
Like our Rock, Paper, Scissors code, 


def game pawns the rest of the game onto other 
functions, with its main function allowing us to 
keep repeating the game by passing the player 
through to the play_again function. 


O Throws 

For our first throw, we want to have five 
random dice. We've set a variable here to pass 
on to our throwing function, allowing us to reuse 


© Ietzen ene 


There are a few variables that 
have duplicates throughout the 
code — while we’ve been careful 
to make sure they work where 
we want them to, it’s not the best 
code conduct. The names of the 
variables don’t specifically matter 
— it’s just best to label them ina 
way you understand for bug fixing 
and others to read. 


cen? } 


it later with a different number that the player 
chooses. We get five random numbers in a list 
returned from the function, and we order it using 
sort to make it a bit more readable for the player 
and also later on for the hand function. 


08 Dice display 
We print out each dice, numbering them 


so the player knows which dice is which, and 
also giving it the name we set at the start of the 
script. We're doing this with a loop that repeats 
itself the number of times as the dice list is 
long using the range(len(dice)) argument. The 
i is increased each turn, and it prints out that 
specific number of the dice list. 


O Current hand 

We want to find the type of hand the 
player has multiple times during the game, so set 
a specific function to find out. We pass the series 
of dice we have on to this function, and print. 


1 Throw again 
Before we can throw the dice for the 
second round, we need to know which dice the 


def throws(): 


roll_number = 5 


dice = roll (roll_number) 


dice.sort() 


result = hand(dice) 


while True: 


try: 


for i in range(len(dice)): 
print “Dice”,i + 1,”:”,names[dice[i]] 


print “You currently have”, result 


if rerolls in (1,2,3,4,5): 


break 
except ValueError: 
pass 
if rerolls == 


else: 


A 2 


print “You finish with”, result 


roll_number = rerolls 


dice_rerolls = roll(roll_number) 
dice_changes = range(rerolls) 
print “Enter the number of a dice to reroll: “ 


iterations = Q 


while iterations < rerolls: 
iterations = iterations + 1 


while True: 
selection = 
try: 


input(“”) 


if selection in (1,2,3,4,5): 
break 
except ValueError: 


pass 


© HINDENIAITO)\ tS) 


Watch the indentations again as 
we split the else function. The 
following page’s code is on the 
same level as roll roll_number, 
dice_rerolls and dice_changes in 
the code. 


rerolls = input(“How many dice do you want to throw again? “) 


print “Oops! I didn’t understand that. Please enter 1, 2, 3, 4 or 5.” 


fo) WHITE SPACE 


The big if function at the end of 
throws doesn’t have many line 
breaks between sections — you 
can add these as muchas you want 
to break up the code into smaller 
chunks visually, aiding debugging. 


ii print “Oops! I didn’t understand that. Please enter 1, 2, 3, 4 or 5.” 
dice_changesLiterations-1] = selection-1 
print “You have changed dice”, selection 


player wants to roll again. We start this by asking 
them how many re-rolls they want to do, which 
allows us to create a custom while loop to ask 
the user which dice to change that iterates the 
correct number of times. 

We also have to make sure it’s a number 
within the scope of the game, which is why 
we check using the try function, and print out 
a message which tells the user if and how they 
are wrong. 


1 Stick 

One of the things we've been trying to do 
in these tutorials is point out how logic can cut 
down on a lot of coding by simply doing process 


of eliminations or following flow charts. If the 
user wants to re-roll zero times, then that means 
they’re happy with their hand, and it must be the 
end of the game. We print a message to indicate 
this and display their hand again. 


1 The re-rolls 

Here’s where we start the second roll 
and the end of the game, using a long else to the 
if statement we just started. We first of all make 
sure to set our variables — updating roll_number 
to pass onto the roll function with the re-roll 
number the user set, and creating the list that’s 
the exact length of the new set of rolls we wish to 
use thanks to range(rerolls). 


13 Parse 

We ask the player to enter the numbers 
of the dice they wish to re-roll. By setting an 
iterations variable, we can have the while loop 
last the same number of times as we want re- 
rolls by comparing it to the reroll variable itself. 
We check each input to make sure it’s a number 
that can be used, and add the valid choices to the 
dice_changes list. We use iterations-1 here as 
Python lists begin at 0 rather than 1. We also print 
out a short message so the player knows the 
selection was successful. 


J 


 —— 
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4 iterations = Q 


while iterations < rerolls: 
iterations = iterations + 1 
replacement = dice_rerollsLiterations-1] 
dice[dice_changesLiterations-1]] = replacement 


15 § dice.sortQ) 


for i in range(len(ice)): 
print “Dice”,i + 1,”:”,names[dice[i]] 


result = hand(dice) 


print “You finish with”, result 


def rollcroll_number): 
numbers = range(1,7) 


7 dice = range(roll_number) 


iterations = @ 


ial while iterations < roll_number: 
iterations = iterations + 1 


dice[iterations-1] = 
return dice 


—_#i 


14 New dice 

We're resetting and reusing the iterations 
variable to perform a similar while loop to update 
he rolls we've done to the original dice variable. 
The main part of this while loop is using the 
iterations-1 variable to find the number from 
dice_changes list, and using that to change that 
specific integer in the dice list with the number 
from the replacement list. So if the first itern on 
he dice_changes list is two, then the second 
item on the dices list is changed to the number 
we want to replace it with. 


1 Sorting 

We're ending the throw function in 
basically the same way we ended the first throw. 
First of all, we re-sort the dice list so that all the 
numbers are in ascending order. Then we print 
out the final cards that the dice correspond to, 
before again passing it onto the hand function 
so that we can fully determine the hand that the 
player has. We print out this result and that ends 
the function, sending the whole thing back to the 
game function to ask if you want to play again. 


1 6 Dice rolling 
The roll function is used twice in the 


code for both times that we roll the dice. Being 
able to use the same code multiple times means 
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random.choice(numbers) 


we can cut down on bloat in the rest of the 
script, allowing it to run a little faster, as we’ve 
explained. It also means in this case that we can 
use it again if you want to change the game to 
three rounds, or modify it for real poker. 


17 Number of rolls 
We begin the whole thing by bringing 


over the roll_number variable into the function 
— this is because while in the original roll it will 
always be five, the second roll could between 
one and the full five dice. We create a list with 
the number of entries we need for each roll, and 
again set an iterations variable for the upcoming 
while loop. 


1 Remember 

Much like the while loops in the rest of the 
code so far, we're keeping it going until iterations 
is the same as roll_number. Each entry in the 
dice list is replaced with a random number using 
the random.choice function and keeping it in the 
range of the numbers variable, which is one to 
six for each side of the dice. After this is done, we 
return the dice variable to the throw function that 
makes up the majority of the game. 


1 9 Hand analysis 
While not technically a hand of cards, 


the poker terminology still applies. We start in 
this function by setting up a few things. The first 
part uses the groupby function we imported — 


© fallels|==Xe)-ane\n ==: 


Which hand is best? What are the 
odds of getting certain hands in 
the game? Some of the answers 
are surprising, as the poker 
hands they’re based on trump the 
differing odds the dice produce. 
We’ve ranked hands from highest 


to lowest. 

Five of a Kind ..........00004+ 6/7776 
Four of a Kind ............ 150/7776 
Full HOUSE ......sseseseeeee 300/7776 
Straight .....ceeeseeeees 240/7776 
Three of a Kind ........ 1200/7776 
TWO Pairs ....s.sseseseseee 1800/7776 
One Pair .........sccce 3600/7776 
High Card oes 480/7776 


this is used in this case to count the numbers 
that make up the dice variable. If there are three 
twos, a four and a five, it will return [3, 1, 1]. We're 
using this to ascertain what kind of hand the 
player has. As the output of this groupby won't 
be in any specific order, we use the sort function 
again to sort it; however, this time we use the 
reverse=TRUE argument to make the analysis 
easier again. 


2 Straights 
Straights and high cards are odd ones 


out in poker dice, as they do not rely on being 
able to count any repetitions in the cards. 
There are, however, only two hands that create 
a straight in poker dice, so we have created 
two lists here that contain them. We can then 
check first to see if the dice make these hands, 
and then if all other checks fail, it has to be a 
high card. 


Your hand 

While seemingly lengthy, this a fairly 
simple if statement. As we stated before, we 
check to see if it’s one of the two straight hands. 
As there are no flushes or royal straight flushes 
in poker dice, we don’t have to worry about those. 
We then check to see if the first item in the list 
is five, which can only result in five of a kind; 
similarly, if the first item is four then the hand 
must be four of a kind. If the first number is three, 
then it can be either a full house or three of a kind, 


def hand@ice): 


dice_hand = [len(list(group)) for key, group in groupby(dice)] 


dice_hand.sort(reverse=True) 


straight1 = [1,2,3,4,5] 
straight2 = [2,3,4,5,6] 


20 ff 
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return “a straight!” 
elif dice_hand[@] == 5: 


if dice == straightl or dice == straight2: 


return “five of a kind!” 


elif dice_hand[@] == 4: 


return “four of a kind!” 


elif dice_hand[@] == 3: 
if dice_hand[1] == 2: 


return “a full house!” 


else: 


return “three of a kind.” 


elif dice_hand[@] == 2: 
if dice_hand[1] == 2: 


return “two pair.’ 


else: 


return “one pair.’ 


else: 
return “a high card.” 


22 def play_again(): 


answer = raw_input(“Would you like to play again? y/n: “) 


if answer in (“y”, 
return answer 
else: 


a As “yes”, “Yes”, “Of course!”): 


fe] TEXT EDITORS 


Instead of the IDE we’ve suggested, you 
should also try coding in a text editor. Some 
of them are a little more lightweight and 
format code similar to the way the IDE does, 
separating functions and strings by colours 
etc. Some of the ones we’d recommend are 
the classic gedit, a popular text editor from 
GNOME desktops; Geany, which has a few 
IDE-esque features written into it; TEA, a 
multifunctioning text editor and project 
manager; and Jedit, a text editor that lives 
in the command line for minimum resource 
usage. These can also be used with multiple 
programming languages, so you can get used 
to them with Python, then make the switch. 


print “Thank you very much for playing our game. See you next time!” 


23 def scores(): 


global player_score, computer_score 


print “HIGH SCORES” 


print “Player: “, player_score 
print “Computer: “, computer_score 


name__ == ‘__main__’: 


startQ 


so we nest an if statement. Again, we do this for 
pairs, where that could be one or two pairs. If all 
else fails then, by a process of elimination, it can 
only be a high card. We give each outcome a text 
string to send back to the throw function so that it 
can be printed. 


22 Play again 
As before, we ask the player for raw input 


with the text offering another game. Instead of 
parsing it, we assume the player will choose a 
specified yes response based on the text, and if 
none of these versions is received, we print out 


the message thanking them for playing the game. 
This ends the game function. 


2 Final scores 

Going all the way back to the start 
function, after the game finishes we move onto 
the results. This section is quite simple — it 
calls the scores, which are integers, and then 
prints them individually after the names of the 
players. This is the end of the script, as far as the 
player is concerned. Currently, the code will not 
permanently save the scores, but you can have 
Python write it to a file to keep if you wish. 


fe] HOMEWORK 


There is currently no scoring in 
place for this version of the game. 
Try adding a computer player, or 
create a rule set that requires a 
certain hand or higher. You could 
even make it two-player. 


2 4 Modules 
The final part of the code allows for 


the script to be used in two ways. Firstly, we 
can execute it in the command line and it will 
work just fine. Secondly, we can import this into 
another Python script, perhaps if you wanted to 
add it as a game to a collection. This last piece of 
code will prevent our script being executed when 
imported by another module — it will only do so 


when being run directly. 


J 
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Create a graphical interface 
for Python games 


Bring everything together with a Python GUI and take the next 
step In programming your own software 


Resources 
Python 2: www.python.org/download 
IDLE: www.python.org/idle 


The start 


Here we’re doing some minor setup, including getting a new 
module that helps us create a simple graphical interface 


The three basic games we have made in 
Python so far have all run in the command line 
or via IDLE, a Python IDE. While this allowed us 
to show off different ways to use Python code, 
we haven't actually shown you how to present 
it yet. In this tutorial, we will take all three 
games and put them all into one neatly unified 
graphical interface. 

To this end, we'll be making use of the small 
line of code we added at the bottom of each 
previous tutorial so we can import them as 


[ #!/usr/bin/env python2 


The imports 


We’re importing the three games we created in past issues so 


we can call upon or use them 


L. from Tkinter import * 


The window 


Create a graphical window and give ita name so we can add 


some functions to it 


The frame 


Define the dimensions of the window and give a rough guide to pe 


placement of the objects within 


g import rockpaperscissors 
Ld import hangman 
__ import pokerdice 


~ root = TkO 


The welcome 


Print a message in the window and place it in a specific 
orientation. This works a little differently to print 


as 


The button 


The focus of this month’s tutorial is making Rock-Paper- 
Scissors work in a graphical interface, so we’re calling a new 


function we’re creating 


Microgames Collection. 


womny 
__ intro.pack(side = TOP) 


The interface 


Creating and formatting buttons to start the other two tutorial 


games in the command line or shell 


rockpaperscissors.gui) 
__ rps_button.pack() 


hm_button.pack() 
The exit 


Here we create a button that quits the window and ends 
the script. We’ve also placed it specifically at the bottom of 


the window 


__ pd_button.pack() 


The loop 


intro = Label(mainframe, text 


modules into our main graphical script. We'll 
also modify the existing code to add some 
graphical elements. To do all this we'll be using 
Tkinter, a default module available in Python 
that allows you to create windows and frames 
with fairly simple code. 

All you need for this tutorial is an up-to-date 
copy of Python, from your distro’s repository 
or the website, and the IDLE development 
environment. This will also work great on 
Raspberry Pi distros, such as Raspbian. 


Main Interface Code Listing 


#Linux User & Developer presents: Mega Microgrames Collection 


|_ root.title (“Linux User & Developer’s Mega Microgames Collection”) 


mainframe = Frame(root, height = 200, width = 50Q) 
mainframe.pack_propagate(Q) 
__ mainframe.pack(padx = 5, pady 


= 5) 


= “Welcome to Linux User & Developers Mega 


Please select one of the following games to play: 


( rps_button = Button(mainframe, text = “Rock, Paper, Scissors”, command = 


hm_button = Button(mainframe, text = “Hangman”, command = hangman.start) 


pd_button = Button(mainframe, text = “Poker Dice”, command = pokerdice.start) 


exit_button = Button(mainframe, text = “Quit”, command = root.destroy) 


rT root.mainloop() 
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__ exit_button.pack(side = BOTTOM) 
The mainloop allows the main window to continue to work and = 
be updated without exiting the program unless specified 


New imports 

Import new modules that allow us to create the GUI 
part of Rock, Paper, Scissors, as well as removing 
the modules we no longer need 


Modified RPS Code Listing 


#!/usr/bin/env python2 


# Linux User & Developer presents: Rock, Paper, Scissors: The Video Game: The Module 


New interface 

Our new main function allows us to call the 
majority of the game script when the rps_button is 
pressed. This contains the game components and 
the graphical components 


from Tkinter import * 
from ttk import * 


import random 


def gui(): 
rock = 1 


New start 

We’ve changed the start function so that it no 
longer goes to the score function after it’s finished. 
We’ve also removed the score function, as we track 
that differently so it can be displayed properly 


paper = 2 
scissors = 3 


names 
rules 


= { rock: “Rock”, paper: “Paper”, scissors: “Scissors” } 
= { rock: scissors, paper: rock, scissors: paper } 


(7. def startQ): 
L while game(): 


New game 

We've changed the game function so that it now 
takes the input from our graphical interface. We 
use a new variable to do this that works with the 
GUI, otherwise it works roughly the same as before 


New results 

The result function remains largely unchanged, 
only now it sends the outcome message to a 
variable we use for the interface, and generally 
uses the new GUI’s variables 


pass 


def game(): 
player = player_choice.get() 
computer = random.randint(1, 3) 
computer_choice.set(names[computer]) 
result(player, computer) 
{def result(player, computer): 
new_score = @ 
if player == computer: 
result_set.set(“Tie game.”) 
else: 
if rules[player] == computer: 
result_set.set(“Your victory has been assured.”) 


New window 

Wecreate the gamewindowwith aslightly different 
method due to already having a ‘mainloop’ root 
window. We’re also giving it a name so you can 
identify it properly 


New variables 

Our new variables are set up so they can interact with 
both the game code and the interface code properly. 
We’ve also made sure to have a default selection for 
the player so that the code runs properly 


new_score = player_score.get() 
new_score += 1 
player_score.set(new_score) 
else: 
result_set.set(“The computer laughs as you realise you have been defeated.”) 
new_score = computer_score.get() 
new_score += 1 
computer_score.set(new_score) 


rps_window = Toplevel() 
rps_window.title (“Rock, Paper, Scissors”) 


player_choice = 
computer_choice = 
result_set = StringVar() 


IntVar() 
StringVar() 


New frame 
Determine the size and layout of the window for 
the game using a slightly different method than 
before. We’ve also allowed for elements to be 
anchored in certain positions around the window 


New choice 

Here we place radio buttons in a_ specific 
configuration in the window, giving the user the 
choice of three moves. This is then passed along to 
the variable and used by the game code 


player_choice.set(1) 
player_score = IntVar() 
computer_score = IntVar() 


rps_frame = 
rps_frame.grid(column=0, row = @, sticky=(N,W,E,S)) 
rps_frame.columnconfigure(®, weight=1) 
rps_frame.rowconfigure(®,weight=1) 


Frame(rps_window, padding = ‘3 3 12 12’, width = 30@) 


Radiobutton(rps_frame, text =’Scissors’, variable = player_choice, value = 
3).grid(column=1, row=4, sticky=W) 


New move 
Here we allow for the computer’s move to be 
displayed under the ‘Computer’ label 


Labe 
Labe 


(rps_frame, text=’Computer’).grid(column=3, row = 1, sticky = W) 
(rps_frame, textvariable = computer_choice).grid(column=3, row=3, sticky = W) 


Button(rps_frame, text=’Play”, command = start).grid(column = 2, row = 2) 


New button 

Pressing the Play button we’ve put here runs the 
game script, prints out the scores and finally a 
message based on the outcome 


Labe 
Labe 


(rps_frame, 
(rps_frame, 


text = “Score”).grid(column = 1, row = 5, sticky = W) 
textvariable = player_score).grid(column = 1, row = 6, sticky = W) 


Label(rps_frame, text=’Player’).grid(column=1, row = 1, sticky = W) 
Radiobutton(rps_frame, text =’Rock’, variable = player_choice, value = 1).grid(column=1, 
row=2, sticky=W) 

Radiobutton(rps_frame, text =’Paper’, variable = player_choice, value = 2).grid(column=1, 
row=3, sticky=W) 


New ending 
We’ve changed this so that the main script begins 
with gui now rather than the start function 


Label(rps_frame, text = “Score”).grid(column = 3, row = 5, sticky = W) 
Label(rps_frame, textvariable = computer_score).grid(column = 3, row = 6, sticky = W) 
Label(rps_frame, textvariable = result_set).grid(column = 2, row = 7) 

{ if __name__ == ‘__main__’: 
guid) 
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‘orf #!/usr/bin/env python2 


#Linux User & Developer presents: Mega Microgrames Collection 


from Tkinter import * 
import rockpaperscissors 
import hangman 

import pokerdice 


root = TkQ) 


mainframe.pack_propagate(Q) 


eee) 
intro.pack(side = TOP) 


rps_button.pack() 


8 8 8 ff 8 of A 


hm_button.pack() 


root.title (“Linux User & Developer’s Mega Microgames Collection”) 
mainframe = Frame(root, height = 200, width = 50Q) 


mainframe.pack(padx = 5, pady = 5) 


© BVANINAWTINI BLO) 


The main interface window that 
this code creates is fairly basic, 
but contains the functions we 
require. The window exit button 
will do the same job as the Quit 
button, and the Hangman and 
Poker Dice buttons run the old 
scripts in the Python shell. 


Se 
Poem went woe 4 roe Mammy genes bo sy 


el ee eee 
see 
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intro = Label(mainframe, text = “””’Welcome to Linux User & Developers Mega Microgames Collection. 
Please select one of the following games to play: 


rps_button = Button(mainframe, text = “Rock, Paper, Scissors”, command = rockpaperscissors.gui) 


hm_button = Button(mainframe, text = “Hangman”, command = hangman.start) 


pd_button = Button(mainframe, text = “Poker Dice”, command = pokerdice.start) 


pd_button.pack() 


exit_button = Button(mainframe, text = “Quit”, command = root.destroy) 
exit_button.pack(side = BOTTOM) 


root.mainloop() 


01 First line 

We use this line to enter the path to the 
Python interpreter. This lets us run the program 
inside a terminal or otherwise outside of a 
Python-specific IDE like IDLE. Note that we're 
also using Python 2 for this particular script. 
O Import graphics 

Tkinter is the graphical interface we're 

using and while it’s a standard Python function, 
you'll need to import the module so you can use it. 
We've used the ‘from [module] import *’ method 
so that we can use the functions from it without 
having to add Tkinter at the beginning. 


0 Import games 


We're importing the modules for the 
three games. We added the line at the bottom 
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of each script so we can do this. To make sure 
to differentiate the functions in each game, we 
will have to specify [module].[function] so there 
are no errors in the code. 


O Root window 

Using the Tk() function creates the 
window we're going to be placing everything 
into. We've decided to call it root for now; 
however, you can call it anything you like, as 
long as you're consistent with it. We've also 
named it using the title command from Tkinter 
and a string of text. 


05 Main frame 
The first line has us set the variable 


mainframe as a Frame in the interface. We’ve 
attached it to root, the main window, and given 


it a minimum height and width in pixels. We 
use pack_propogate to create the window, and 
hen make sure it’s the size that we've defined. 
We've then used pack to pad the borders, 
allowing the contents of the window to not 
ouch the sides of it. 


0 Introductions 

We create the intro variable as a label 
hat lives in the main frame. We give it text to 
introduce the interface, using the triple quote 
marks to have it go across multiple lines and 
format better. We then use pack to display it, and 
ell Tkinter to put it at the top of the interface. 


07 Rock, Paper, Scissors 


We create a button for the Rock, Paper, 
Scissors game using the Button function. We 
attach to it the main frame, give it a label using 


#!/usr/bin/env python2 


# Linux User & Developer presents: Rock, Paper, Scissors: The Video Game: The Module 


from Tkinter import * 
from ttk import x 
import random 


a def guiQ: 


rock = 1 
paper = 2 
scissors = 3 


names = { rock: 


“Rock”, paper: “Paper”, scissors: “Scissors” } 


rules = { rock: scissors, paper: rock, scissors: paper } 


def startQ): 
while game(): 
pass 


computer = random.randint(1, 3) 
computer_choice.set(names[computer]) 
result(player, computer) 


text that appears on the button, and then have 
it run a command. In this case, we use the 
modified rockpapershotgun.py code that has a 
gui function, hence rockpapershotgun.py. We 
then use pack to place it in the window 


0 Other games 


For the other two games, the code is 
mostly the same; however, we call upon the start 
function in both of them. In the final interface, 
this will cause the games to run in the shell or 
command line as they’ve been running before. 


09 Break the loop 
The exit button works similarly to the 


other buttons we've created, but instead it uses 
the command root.destroy. This ends the loop 
that we've created with root.mainloop(), which 
allows the interface code to continue looping, 
allowing us to continually use it. We place the 
exit button at the bottom of the window with 
‘side = BOTTOM’. 


1 Game code 

Nothing much has changed in the start of 
this code, other than a few import changes. The 
code for running it in the command line is still 


def game(): 
player = player_choice.get() 


there, and with a few modifications the code will 
run independently of the main interface. We've 
removed the time module, as we no longer need 
it, and imported not only the Tkinter module, 
but the ttk module. The ttk module allows us to 
arrange the GUI in a grid, which will be slightly 
easier to use and understand. 


1 Game interface 

One of the biggest changes we’re making 
to this script is having it all contained in one 
function, ‘def gui’. The interface code needs to 
be put into a function, otherwise it will be run 
during import. While we’ve chosen to put the 
entirety of the code in a function, you can also 
try just having the graphical interface code in 
one. All our variables are kept in here so that 
they still work properly. 


1 Game variables 

The variables are staying the same 
so that we can do the same comparisons we 
made in the original code. We’ve put them into 
the function itself so that they don’t affect the 
other imported code into the main interface — 
and so that when calling just this function, we 
don’t need to use global to bring them in. 


fe} PYTHON SHELL 


Our other code will run in the shell 
or via a command line in the same 
way as before when the buttons 
are pressed. 


1 Start function 

We've removed the part that calls 
the score function from the start function, 
as we have the interface handle the scoring 
now. It still calls upon the game function, 
though, putting it into a loop so it can be 
used continuously. This function is called by 
the interface to begin the game by setting a 
computer move and then comparing it to the 
player's choice. 


14 Game function 
The game function has had a few 


modifications to make sure it works with 
the interface. First of all, the player variable 
is retried using get() on the special variable 
we've created to contain the player choice. 
We do a similar thing for the computer, using 
‘set’ to change the variable in our interface- 
friendly computer_choice value. We still use 
the name variable to set the text that goes into 
computer_choice. This then passes the player 
and computer variables along in the same way 
we did before. 


7 
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nsf def result(player, computer): 


new_score = Q 
if player == computer: 


else: 
if rules[player] == 


result_set.set(“Tie game.”) 


computer: 


result_set.set(“Your victory has been assured.”) 
new_score = player_score.get() 


new_score += 1 


player_score.set(new_score) 


else: 


result_set.set(“The computer laughs as you realise you have been defeated.”) 
new_score = computer_score.get() 


new_score += 1 


computer_score.set(new_score) 


rps_window = Toplevel() 
rps_window.title (“Rock, Paper, Scissors”) 


player_choice = IntVar() 


computer_choice = StringVar() 


result_set = StringVar(Q) 
player_choice.set(1) 
player_score = IntVar() 
computer_score = IntVar() 


—_&i 


15 Result function 
The result function still takes the same 


two variables as before, which we set in the 
game function. While technically we can use 
the variables set up for the interface, these 
are not pure integers and can cause an error if 
not handled correctly. With that in mind, we've 
created an empty new_score variable that we 
can use to effectively clean the interface value 
before adding it back into it. 


1 Tie 

The logic for determining the result is 
the same as before. We first do the easy check — 
whether or not the numeric value for the player 
and computer variable is the same. What changes 
this time is that, instead of printing the text, 
we send the “Tie game” message to our result 
variable using the set function from Tkinter. 


17 Win 

The if statement continues by seeing if 
the player has won. Like before, we use the rules 
we set to make the comparison for the code to 
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to the main interface. 


make. We set the result_set like we did in the 
tie game, with a different message to the user. 
Finally, we set the new_score variable to be the 
current player score, using the get function to 
obtain it, plus one to the score, and then use 
set again to put it back into the player_score 
variable. We can’t use += with the player_score 
variable, as it is not a standard variable. 


18 Lose 

This part of the overall if statement 
works in the same way as before, by assuming 
that if it isn’t a tie or a win, it’s a loss. Like the 
new version of the win code, it then uses set 
to change the message that will be displayed 
to the player, and calls upon and changes 
the computer score by putting it through the 
new_score variable. 


19 New window 
As the original window is part of the 


mainloop, we cannot have the window be 
created using Tk() like in the main interface 
code. As this window is coming off it, though, 
we instead create it using Toplevel(). This 
allows the window to run separately and on 
top of the main window. We've also given 


fe] GAME WINDOW 


In its default state, the game 
window will have rock selected 
and no message will be displayed. 
Once the player makes a move, the 
message will be displayed at the 
bottom and the computer’s move 
will be printed. There’s no quit 
button on this menu, but clicking 
the window exit will bring you back 


it a name, which will not change the main 
window’s name in the process. 


2 Interface variables 

Here is the reason we had to call and 
change the variables in a different manner. 
For Tkinter, we need to let the interface know 
whether or not a variable is an integer or a text 
value. IntVar and StringVar allow for these 
respectively. We've also set the player_choice 
variable to be one, which we have already set as 
the choice for rock. This means there will at least 
be a default choice when the game is started, 
and it won't cause an error. 


2 Game frame 

We've created the frame for our 
interface items slightly differently. Instead 
of using the pack command in the main 
interface, we're using grid to make sure they’re 
orientated in such a way that makes sense 
for the user. Padding does just that, setting 
up values to make sure the items in the frame 
don’t touch the edge of the window. Using the 
grid command, we then create this frame. 
The row and column variables allow for rows 
and columns to be included in the structure of 


/ 


rps_frame = Frame(rps_window, padding = ‘3 3 12 12’, width = 30Q) 
rps_frame.grid(column=0, row = Q, sticky=(N,W,E,S)) 
rps_frame.columnconfigure(@, weight=1) 
rps_frame.rowconfigure(@,weight=1) 


Label(rps_frame, text=’Player’).grid(column=1, row = 1, sticky = W) 

Radiobutton(rps_frame, text =’Rock’, variable = player_choice, value = 1).grid(column=1, row=2, 
sticky=W) 

Radiobutton(rps_frame, text =’Paper’, variable = player_choice, value = 2).grid(column=1, row=3, 
sticky=W) 

Radiobutton(rps_frame, text =’Scissors’, variable = player_choice, value = 3).grid(column=1, 
row=4, sticky=W) 


Label(rps_frame, text=’Computer’).grid(column=3, row = 1, sticky = W) 
Label(rps_frame, textvariable = computer_choice).grid(column=3, row=3, sticky = W) 


Button(rps_frame, text=’Play”, command = start).grid(column = 2, row = 2) 


Label(rps_frame, text = “Score”).grid(column = 1, row = 5, sticky = W) 
Label(rps_frame, textvariable = player_score).grid(column = 1, row = 6, sticky = W) 


Label(rps_frame, text = “Score”).grid(column = 3, row = 5, sticky = W) 


—l_, 8 a, _ #4, 


. 


name == ‘__main 
gui() 


a 


the window, and the sticky allows us to justify 
items with specific directions — in this case top, 
left, right and bottom justification. Finally, we 
then make sure each column and row is treated 
equally by giving them the same weighting, and 
starting from zero. 


22 Player’s choice 
We create a label for the player’s move 


and assign it to a grid location, on the first row, 
on the first column. We also justify it to the left 
using ‘sticky = W’. We then add the radio buttons 
for the player’s move, each on the same column 
but the following row down. We give each choice 
a name, then assign it to the player_choice 
variable. We then make each choice have a 
numerical value that corresponds to the moves 
we've determined in the first set of rules. 


2 Computer’s move 
We display the computer move here. 
First of all, we label what this is and then create 


Label(rps_frame, textvariable = computer_score).grid(column = 


Label(rps_frame, textvariable = result_set).grid(column = 2, row 


a second label to display the actual move. We 
do this by adding the textvariable option to 
Label, and using the computer_choice variable 
we updated earlier in the game function. This 
merely prints the text from the names list and 
justifies this to the left. 


24 Press Play 
The running of the code all hinges on 


the Play button. It’s very simple: we put it in the 
row between the Player and Computer move as 
part of our three-column system; and it runs the 
start function using the command option. Due to 
the loop of the interface, we can keep pressing 
this without needing to be asked to play again. 
Simply exiting the window will go back to the 
main interface window as well, meaning we do 
not need a specific quit button. 


25 Running score 
We have two sets of scores to display 


— one for the player and the other for the 


3, row = 6, sticky = W) 


= 7) 


computer. We label these the same way we've 
done with labelling the Player and Computer 
move, having them on a lower row but still in 
the relevant columns. Below that, we use the 
textvariable option again to get the numerical 
score we assigned to the separate score 
variable. Finally, we create another label to 
display the message for the game’s outcome 


26 End game 
The final part of the code allows for 


the script to be used by the main window, and 
also allows for it to run on its own when used 
in the command line or shell. You'll need to 
perform some modifications to make it run on 
its own, such as making it the mainloop and not 
a Toplevel window. However, it will run just fine 
from both without the need to be launched from 


the main interface. 
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Bring graphics to simple 
Python games 


Complete your trio of games with a graphical interface for the 
hangman and poker dice code 


Resources 


Python 2: www.python.org/download 


IDLE: www.python.org/idle 


We have now created a simple selector for the 
trio of Python games we made previously. This 
interface was able to launch a GUI for our rock, 
paper, scissors game, and run the other two in 
the terminal. Now, we’re going to convert the 
hangman and poker dice codes to work in a 
similar way to rock, paper, scissors. 

The trick with hangman comes in allowing 
for a different type of input, text, and the ability 
to have multiple rounds of the game. Tkinter 
allows for text entry, and we rely a lot less on 


‘while’ loops to play the game in its entirety. 
Poker Dice needs to keep the dice analysis 
code, and the option to change specific dice 
using checkboxes. 

We'll be modifying a large amount of the 
original code to fit in with the new graphical 
scheme. This mainly involves cutting specific 
parts and having the Tkinter-specific code 
handle these itself. The code listings on these 
pages include the modified code — we'll discuss 
the graphical part on the following pages. 


1 Imported isti 
iether ieee Hangman Code Listing 
same minor setup, from Tkinter import * if letter == wordLi]: 
including getting from ttk import * clue[i] = letter 
the Tkinter module from random import * hangedman(letters_wrong) 
that helps us create word = Q clue_set = “ “.join(clue) 
a simple graphical werd Ieee) = word_output.set(clue_set) 
interface clue = if letters_wrong == tries: 
result_text = “Game Over. The word 
2 Words def gui(): was “ + word 
We're keeping global word, word_length, clue result_set.set(result_text) 
our variables that dictionary = [“gnu”, kernel”, ”linux”,””magei new_score = computer_score.get() 
determine the word to a”, "penguin”, "ubuntu" ] new_score += 1 
guess here soitcan word = choice(dictionary) computer_score.set(new_score) 
be easily accessed word_length = len(word) if “”.join(clue) == word: 
anywhere in the code clue = word_length * [“_”] result_text = “You Win! The word 
‘ tries = 6 was “ + word 
3 Function result_set.set(result_text) 
Like last time, we're def hangedman(hangman) : new_score = player_score.get() 
putting the majority of graphic = new_score += 1 
our original code into a aan player_score.set(new_score) 
new function, gui foemese, rs 
: | | def guess_letter(): 
4Analysis | 0 letter = letter_guess.get() 
We select the word | -|- letter.strip() 
and analyse it before | letter. lower () 
continuing on with the | return letter 
rest of the code =o 
. | def reset_game(): 
5 Graphics graphic_set = graphic[hangman] global word, word_length, clue 
The hangedman hm_graphic.set(graphic_set) incorrect_guesses. set (Q) 
functionis largely _ hangedman(@) 
unchanged, albeit with f game(): result_set.set(“”) 
new code to display letters_wrong = incorrect_guesses.get() letter_guess.set(“”) 
our ASCII graphics on letter=guess_letter() word = choice(dictionary) 
the interface first_index=word.find(letter) word_length = len(word) 
if first index == -1: clue = word_length * [“_”] 
6 Guesses letters_wrong +=1 new_clue = “ “.join(clue) 
We check the number incorrect_guesses.set(letters_ word_output.set(new_clue) 
of mistakes made, and wrong) 
call the guess_letter else: if __name__ == ‘__main__’: 
function to check the for i in range(word_length) : guid) 


letter entered 
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1 Moreimports 

We've added the new imported 
modules we need to make Tkinter 
work and keep the rest the same 


2 Dice list 

The list that holds the dice is kept 
outside the main function so that it 
can be accessed everywhere 


3 Rolls 

Same goes for the roll function. 
It doesn’t specifically need to be 
inside the gui function anyway 


4Decisions 

The checkboxes in the graphical 
code we're going to create later will 
give us numbers we can analyse for 
the code. We retrieve these numbers 
and check them to find out which 
dice the user wishes to re-roll 


5 Hands 

Finally, our hand analysis function 
is the last part of the original code 
that is kept outside the gui function. 
Both this and the above function 
pass the necessary details back 

up the chain to then be added into 
the new graphical elements of the 
new interface 


6 Nodice 

If no dice have been selected to 
re-roll, the hand output is changed 
to show a final message 


7 Re-roll 

This part is almost the same as 
before — anew set of dice are rolled 
and then inserted into the list of dice 
like before, then re-sorted to make 
the hand analysis easier 


8 More functions 

The new gui function is the main 
change to the Poker Dice code, 
and as before includes the Tkinter 
elements and other parts of the 
original code 


9 Game start 
Asimple function that we can use to 
activate the re-rolls of the dice 


10 New hand 

The new dice are named, analysed, 
and everything is then set for the gui 
to display the final outcome 


11 Reset 

Like with the hangman code, we 
have a function to reset all the 
variables, allowing you to start the 
game again 


from Tkinter import * 

from ttk import * 

import random 

from itertools import groupby 


def roll(roll_number): 


choice(numbers) 


def gui(): 


“yr 


def hand(dice): 
group in groupby(dice) ] 
straight2: 


numbers = range(1,7) 

dice = range(roll_number) 

iterations = Q 

while iterations < roll_number: 
iterations = iterations + 1 
diceLiterations-1] = random. 


return dice 


dice_hand = [len(list(group)) for key, 


dice_hand. sort (reverse=True) 
straight1 = [1,2,3,4,5] 
straight2 = [2,3,4,5,6] 

if dice == straightl or dice == 


return “a straight!” 
elif dice_hand[Q] == 5: 

return “five of a kind!” 
elif dice_hand[Q] == 4: 


return “four of a kind!” 
elif dice_hand[Q] == 3: 
if dice_hand[1] == 2: 
return “a full house!” 
else: 
return “three of a kind.” 
elif dice_hand[Q] == 2: 
if dice_hand[1] == 2: 
return “two pair.” 
else: 
return “one pair.” 
else: 
return “a high card.” 


global dice 
dice = roll(5) 
dice.sort() 
nine = 1 

ten = 2 

jack = 3 

queen = 4 
king = 5 
ace = 6 
names = { nine: “9”, ten: “10”, jack: 
queen: “Q”, king: “K”, ace: “A” } 
result = “You have “ + hand(dice) 


def game(): 
throws() 
if 
def throws(): 


ber) 


changesLiterations-1]] = 


—_name__ == 


Poker Dice Code Listing 
global dice 
dicel_check = 
dice2_check = 
dice3_check = 
dice4_check = 
dice5_check = 
dice_rerolls = 


dicel.get() 
dice2.get() 
dice3.get() 
dice4.get() 
dice5.get() 
[dicel_check, 


dice2_check, dice3_check, dice4_check, 
dice5_check] 


for i in range(len(dice_rerolls)): 
if @ in dice_rerolls: 
dice_rerolls.remove(Q) 
if len(dice_rerolls) == Q: 
result = “You finish with “ + 


hand(dice) 


hand_output.set (result) 

else: 
roll_number = len(dice_rerolls) 
number_rerolls = roll(roll_num- 


dice_changes = range(len(dice_ 


rerolls)) 


iterations = @ 

while iterations < roll_number: 
iterations = iterations + 1 
dice_changesLiterations-1] 


number_rerolls[iterations-1] 


iterations = @ 

while iterations < roll_number: 
iterations = iterations + 1 
replacement = number_ 


rerolls[iterations-1] 


dice[dice_ 

replacement 

dice.sort() 

new_dice_list = [0,0,0,0,0] 

for i in range(len(dice)): 
new_dice_list[i] = 


names[diceLi]] 


final_dice = “ “.join(new_dice_ 


list) 


dice_output.set(final_dice) 
final_result = “You finish with 


Hof + hand (dice) 
hand_output.set(final_result) 


def reset_game(): 
global dice 
dice = roll(5) 
dice.sort() 
for i in range(len(dice)): 

empty_diceLi] = names[dice[i]] 

first_dice = “ “.join(empty_dice) 
dice_output.set(first_dice) 
result = “You have “ + hand(dice) 
hand_output.set (result) 


‘__main__’: 
gui() 


The Python Book 51 


NX 


#!/usr/bin/env python2 


from Tkinter import * 
from ttk import * 
from random import x 
word = @ 

word_length = @ 

clue = @ 


def gui(): 


A A 


global word, word_length, clue 
dictionary = [“gnu”,”kernel”,” linux”, ”mageia”,”penguin”, ”ubuntu”] 


word = choice(dictionary) 
word_length = len(word) 


clue = word_length * [“_”] 


tries = 6 


def hangedman(hangman) : 


'O Melelmes)= 


When you’ve run out of guesses, 
the game stops. From here, you 


graphic = [ can also reset the game to play 
fun again if you wish. 
+------- + 
| | 
| 0 
| == 
| /\ 
| 
anny 
graphic_set = graphicLhangman] 


hm_graphic.set(graphic_set) 


def game(): 


a 


letter=guess_letter() 


letters_wrong = incorrect_guesses.get() 


first_index=word.find(letter) 


if first_index == -1: 
letters_wrong +=1 


incorrect_guesses.set(letters_wrong) 


else: 


for i in range(word_length): 
if letter == word[i]: 


clueLi] = 
hangedman(letters_wrong) 
clue_set = “ “.join(clue) 
word_output.set(clue_set) 


AA 


letter 


if letters_wrong == tries: 


result_text = “Game Over. 


“+ word 


The word was 


result_set.set(result_text) 


new_score = 
new_score += 1 


computer_score. get() 


computer_score.set(new_score) 
if “”.join(clue) == word: 


result_text = 


“You Win! The word was “ + word 


result_set.set(result_text) 


new_score = 
new_score += 1 


player_score.get() 


player_score.set(new_score) 


01 First lines 

As usual, we start off each program with 
the code that lets us run it in the command line, 
followed by importing the necessary modules: 
random, to determine the word to use; Tkinter, 
for the majority of the graphical code; and 
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ttk, for the grid code we'll be using to align the 


different elements. 
0 Global variables 

We have kept these three variables 
outside of the gui function so they can be 


accessed at all points in the code. Python 2 does 

not allow you to call upon global variables when 

you're in a nested function, whereas in Python 3 

this could have gone into the gui function. 
Graphical function 


0 We're putting all the working code into 
the gui function so it can be activated from the 
main interface. This means we can import the 
Hangman code into the interface without the 
game window popping up, and only run it when 
we activate the gui function from here. 


0 4 Random word 
We bring in the three variables with 


global so we can modify them throughout 
the code, and then set the word. As before, a 
random item from the list of words is selected 
with choice, the length is ascertained, and the 
clue to display is set. 
O The hanged man 

The main difference this time for the 
Hangman graphics is that instead of printing 
these out, we're going to display them in the 
interface. When the function is called and the 


graphic selected, it’s placed in the variable we've 
set up in the interface code that we're using to 


display the result. 
O Games begin 

All the analysis of the letter we've 
entered is done in this function. To that end, we 
start by obtaining the incorrect guesses so far 
from the variable we've set up so the interface 
can access it if we want it to. The letter from 
the entry field in the interface is then obtained 
and cleaned up so it can be used with the rest of 


the code. 
07 Check the letter 

This section of the code is again largely 
unchanged - the letter is taken and compared to 
the word with find to see if it matches with one 
of the letters. The if statement then adds one to 
the incorrect guess variable, or updates the clue 
variable to add the letter in the right spot. 
O 8 Update interface 

These three lines set the graphic for this 


round, join the current clue together as a string, 
and then set it on the variable for the interface 


toread. 
0 Update scores 

Exactly as before, we check to see if the 
player has won or lost yet. In the event of either, 
a message is displayed to signify this, and the 
wins and losses score is updated using set. 


def guess_letter(): 
letter = letter_guess.get() 
letter.strip( 
letter. lower() 
return letter 


def reset_game(): 
global word, word_length, clue 
incorrect_guesses.set(@) 
hangedman(@) 
result_set.set(“”) 
letter_guess.set(“”) 
word = choice(dictionary) 
word_length = len(word) 
clue = word_length * [“_”] 
new_clue = “ “.join(clue) 
word_output.set(new_clue) 


hm_window = Toplevel() 
hm_window.title (“Hangman”) 
incorrect_guesses = IntVar() 
incorrect_guesses.set(Q) 
player_score = IntVar() 
computer_score = IntVar() 
result_set = StringVar() 
letter_guess = StringVar() 
word_output = StringVar() 
hm_graphic = StringVar() 


hm_frame. rowconfigure(@,weight=1) 


fH, f.8, & _ 6 


1 Sanitise input 

The guess_letter function purely gets 
the letter from the player input variable, strips it 
of any formatting, makes it lower case, and then 
returns it back to the game function. This is so 
the letter can be used properly. 


1 1 New window 

We use the Toplevel command from 
Tkinter like last month to separate the loops of 
the main interface and game window. We then 
use title to call it Hangman. 


1 2 Interface variables 

Tkinter only works with specific variables 
— we've created all the ones we need or can use 
here. IntVars take integers, while StringVars take 
strings. We've used get and set throughout the 
rest of the code with these to get and set values. 


Q TORCH MING =a er= 


You'll also need the interface 
which 
already works with the modified 
Rock, Paper, Scissors code. The 


code from last issue, 


fe) THE HANGMAN GUI 


Press the updated Hangman 
button to launch a new window. 
Here we have the initial graphic, 
word clue and entry for the player 


way it was left off means it won’t to interact with. The scores 


work with the new code, so you'll 
have to change the command in 
each button from [game].start 


to [game].gui. 


hm_frame = Frame(hm_window, padding = ‘3 3 12 12’, width = 300) 
hm_frame.grid(column=0, row = @, sticky=(N,W,E,S)) 
hm_frame.columnconfigure(®, weight=1) 


Label(hm_frame, textvariable = hm_graphic).grid(column=2, row = 1) 
Label(hm_frame, text=’Word’).grid(column=2, row = 2) 
Label(hm_frame, textvariable = word_output).grid(column=2, row = 3) 


Label(hm_frame, text=’Enter a letter’).grid(column=2, row = 4) 
hm_entry = Entry(hm_frame, exportselection = @, textvariable = letter_guess).grid(column 


hm_entry_button = Button(hm_frame, text = “Guess”, command = game).grid(column = 2, row 
Label(hm_frame, text = “Wins”).grid(column = 1, row = 7, sticky = W) 

Label(hm_frame, textvariable = player_score).grid(column = 1, row = 8, sticky = W) 
Label(hm_frame, text = “Losses”).grid(column = 3, row = 7, sticky = W) 


Label(hm_frame, textvariable = computer_score).grid(column = 3, row = 8, sticky = W) 
Label(hm_frame, textvariable = result_set).grid(column = 2, row = 9) 


replay_button = Button(hm_frame, text = “Reset”, command = reset_game).grid(column = 2, 
if _.name__ == ‘__main__’: 
guid) 


ives frame is set 
up as before il 


1 3 Framed window 

The frame is set up the same way as 
last time. We pad the frame from the edge of 
the window, set a grid, give it sticky points at 


compass points, and allow for setting objects 
with specific row and column points. 


1 Clue to Hangman 

These labels are fairly straightforward 
— we're either giving them fixed text, or telling 
them to use a specific textvariable so they can 
be updated as we play the game. 


are set to zero, and no result 
message is displayed as no 
games have been played yet. 


= 2, row = 5) 
= 6) 


row = 10) 


1 Text entry 

Entry here sets a text box we will add the 
letters to. The exportselection option makes it 
so selecting the letter won't immediately copy it 
to the clipboard, and the textvariable selection 
is where the code stores the letter added. The 
button activates the game function, analysing 
the letter the player entered. 


1 6 Results and reset 

The rest of the code is similar to what 
we've done already: labels to display fixed text 
and the scores/result text that change. The 
button that activates the reset function is also 
put at the bottom here. The final two lines allow 
us to import the module into the interface code. 


VA 
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1 Start over 

The usual array of command-line 
compatibility and module importing here. The 
groupby function is specifically imported here 
for dice analysis. 


1 Outside dice 

For Poker Dice, there’s only one variable 
to show at any one time, the dice. Again, due to 
the nested functions, and because we're using 
Python 2, we need to call it with global from here 
to make sure the game can be reset properly. 


1 9 Dice rolls 

The roll function has been removed from 
the gui function so as not to create any code 
errors with some of its variables. It can be easily 
called within the nested functions. It hasn’t 
changed at all from the original code. 


2 Hand of dice 

Like roll, nothing has changed for the 
hand function. It’s simply now placed outside 
the gui function for the exact same reasons. 
t also means that you can easily import this 
function into another script if you wish. 


2 GUI start 

As we've mentioned last month and in 
the Hangman code, we put all the GUI code into 
a function so that we can call on it when we want 
to. In this case, pressing the Poker Dice button 
on the main interface activates pokerdice.gui, 
which is this function. 


22 First roll 
As the window opens, we immediately 


make the first roll. This is then sorted, each 
number is attributed to a card, and then the 
result is created to be displayed in the main 
window. This is similar to how it worked before, 
but instead it’s now entered into the StringVars 
for the interface towards the end of the script 


23 Start game 
When we activate the button that starts 


game, it immediately sends us to the rest of the 
code. This would also work if you had the button 
go to the throws function instead; however, you 
can add other functions to this part if you wish. 


2 4 Dice selection 
The first thing we do is find out what 


checkboxes have been ticked by the player. We 
then put these in a list so we can change out the 
correct dice numbers. We've also brought in dice 
so we can check against that what the current 
dice rolls are. 
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#!/usr/bin/env python2 


from Tkinter import * 

from ttk import * 

import random 

from itertools import groupby 
dice = @ 


def roll (roll_number): 
numbers = range(1,7) 
dice = range(roll_number) 
iterations = 0 


Q Exar NCNV aise Neues 


We mentioned that the game function 
doesn’t necessarily need to be used right 
now. You can either clean up the code and 
remove it, or add extra functions, such 
as being able to choose a random new 
selection of dice, or making it two-player. 
Experiment with what you want to do! 


while iterations < roll_number: 
iterations = iterations + 1 


dice[iterations-1] = 
return dice 


def hand(dice): 
dice_hand = 
dice_hand. sort (reverse=True) 
straight1 = [1,2,3,4,5] 
straight2 = [2,3,4,5,6] 


random. choice(numbers) 


[len(list(group)) for key, group in groupby(dice)] 


if dice == straightl or dice == straight2: 


return “a straight!” 
elif dice_hand[@] == 5: 

return “five of a kind!” 
elif dice_hand[@] == 4: 

return “four of a kind!” 
elif dice_hand[@] == 3: 

if dice_hand[1] == 2: 

return “a full house!” 
else: 


return “three of a kind.” 


elif dice_hand[@] == 2: 
if dice_hand[1] == 2: 
return “two pair.” 
else: 
return “one pair.” 
else: 
return “a high card.” 


f guid): 

global dice 
dice = roll(5) 
dice.sort() 
nine = 1 

ten = 2 

jack = 

queen = 4 
king = 5 

ace = 6 


names = { nine: “9”, ten: “10”, 


“A” ¥ 


“result = “You have “ + hand(dice) 


def game(): 
throws() 


def throws(): 
global dice 
dicel_check dicel.get() 
dice2_check = dice2.get() 
dice3_check = dice3.get() 
dice4_check = dice4.get() 
dice5_check = dice5.get() 


© alae) ,4=1-ap)(e=ac10) 


Two things are being printed out 
on the initial window. The first 
set of dice, ordered in the way 
we did last time, and the current 
hand. The checkboxes activate 
a specific number that is used 
when re-rolling dice with the 
Reroll button. 


jack: “J”, queen: “Q”, king: “kK”, 


dice_rerolls = [dicel_check, dice2_check, dice3_check, dice4_ 


check, dice5_check] 


| 


for 


if 


a 
a els 


def res 
glol 
dic 
dic 
for 
fir 
dic 
res 
han 


pd_wind 
pd_wind 
dice_ou 
empty_d 
for i i 

emp 
first_d 
dice_ou 
hand_ou 
hand_ou 
dicel 
dice2 
dice3 
dice4 
dice5 
result_ 
player_ 
compute 


pd_fram 
pd_fram 
pd_fram 
pd_fram 
Label (p 
Label(p 
Label(p 


Label(p 
reroll1 
®).grid(c 
reroll2 
®).grid(c 
reroll3 
®).grid(c 
reroll4 
®).grid(c 
reroll5 

= @).grid(c 
pd_rero 

3, row = 6) 
replay_ 
row = 


= 3 


if __name__ 
guid) 


i in range(len(dice_rerolls)) 
if @ in dice_rerolls: 
dice_rerolls.remove(@) 
len(dice_rerolls) == 
result = “You finish with “ + hand(dice) 
hand_output.set(result) 
134 
roll_number = len(dice_rerolls) 
number_rerolls = roll(roll_number) 
dice_changes = range(len(dice_rerolls)) 
iterations = @ 
while iterations < roll_number 
iterations = iterations + 1 
dice_changes[iterations-1] = number_rerolls[iterations-1] 
iterations = 0 
while iterations < roll_number 
iterations = iterations + 1 
replacement = number_rerolls[iterations-1] 
dice[dice_changes[iterations-1]] = replacement 
dice.sort() 
new_dice_list = [0,0,0,0,0] 
for i in range(len(dice)): 
new_dice_list[i] = names[dice[i]] 
final_dice = “ “.join(new_dice_list) 
dice_output.set(final_dice) 
final_result = “You finish with “ + hand(dice) 
hand_output.set(final_result) 


et_game(): 
bal dice 
e = roll(5) 
e.sort() 

i in range(len(dice)): 
empty_diceLi] = names[diceLi]] 
st_dice = “ “.join(empty_dice) 
e_output.set(first_dice) 
ult = “You have “ + hand(dice) 
d_output.set (result) 


low = Toplevel() 
low.title (“Poker Dice”) 
tput = StringVar() 

ice = [0,0,0,0,0] 

n range(len(dice)): 
ty_dice[i] = names[dice[i]] 
ice = “ “.join(empty_dice) 
tput.set(first_dice) 

tput = StringVar() 
tput.set(result) 

IntVar() 

IntVar() 

IntVar() 

IntVar() 

IntVar() 

set = StringVar() 

score = IntVar() 

r_score = IntVar() 


to the main page. 


ie = Frame(pd_window, padding = ‘3 3 12 12’, width = 300) 
e.grid(column=0, row = @, sticky=(N,W,E,S)) 
e.columnconfigure(®@, weight=1) 

ie. rowconfigure(@,weight=1) 


d_frame, text=’Dice’).grid(column=3, row = 1) 


'Q ONS een 


The waywe’ve made these Tkinter 
interfaces is to have the games 
launch in a separate window. You 
can have them all running in one 
window, though, by replacing the 
labels and buttons of the original 
interface by putting them as 
different functions or classes. 
Make sure to add a quit button to 
the games that lets you go back 


d_frame, textvariable = dice_output).grid(column=3, row = 2) 

d_frame, textvariable = hand_output).grid(column=3, row = 3) 

d_frame, text=’Dice to Reroll?’).grid(column=3, row = 4) 

= Checkbutton(pd_frame, text = “1”, variable = dicel, onvalue = offvalue 
olumn=1, row = 5) 

= Checkbutton(pd_frame, text = “2”, variable = dice2, onvalue = offvalue 
olumn=2, row = 5) 

= Checkbutton(pd_frame, text = “3”, variable = dice3, onvalue = offvalue 
olumn=3, row = 5) 

= Checkbutton(pd_frame, text = “4”, variable = dice4, onvalue = offvalue 
olumn=4, row = 5) 

= Checkbutton(pd_frame, text = “5”, variable = dice5, onvalue = offvalue 
olumn=5, row = 5) 

11_button = Button(pd_frame, text = “Reroll”, command = game).grid(column = 
button = Button(pd_frame, text = “Reset”, command = reset_game).grid(column 
7) 

== ‘ _main__’: 


om check 
buttons are new 
Dice to re-roll 


2 If a checkbox isn’t selected, we have 

it set to give a zero value. We want to remove 

these from the list so that the correct dice 

are changed, so we use the for loop to check 

each part of the list, and then use the remove 

function when the element does equal zero. 
Early finish 


2 If no dice have been selected to re-roll, 
he list will contain all Os, which will then be 
removed. The length of this list will then also be 
zero, Meaning we can use that to end the game if 
he player hits Reroll without selecting any dice. 


27 New dice 
This else function works roughly 


the same as before. We start by getting the 

necessary information for how many dice to roll, 

and alist to put the re-rolls. We then roll as many 

new dice as we need with the first while loop 
Game over 


2 We use the same kind of while loop to 
replace the new numbers into the original list, 
much like last time. Then the dice are re-sorted, 
analysed, joined as a string and then set into the 
interface’s variable. The final hand message is 


also create and set. 
2 Graphical variables 

As we're rolling the dice as soon as 
we launch the game, but the interface code 
doesn’t start until the end, you can see that 
after creating the necessary variables, we also 
then set them. Of note, the dice have to be made 
into a string separately with the for loop before 
adding to the variable. 
3 Check buttons 

The main new addition to this code is 
the check buttons with Checkbutton. You can 
set an on and off value, with default off being 0. 
We've made it so that the check buttons return 
the same number as the dice they’re changing, 
which we explained how we used earlier in the 
code. The variable option sets whatever the 
outcome is to the specific Tkinter variable. 
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Build an app for 
Android with Python 


Master Kivy, the excellent cross-platform application 
framework to make your first Android app... 


@ Here we've drawn all the simple graphics 
for our game... now we just have to make 
the shapes actually do something! 


The great thing about Kivy is there are loads 
of directions we could take it in to do some 
pretty fancy things. But, we're going to make 
a beeline for one of Kivy's coolest features 
- the ability it affords you to easily run your 
programs on Android. 

We'll approach this by first showing how to 
make a new app, this time a dynamic Breakout- 


Before anything else, let's throw together a 
basic Kivy app (Fig. 01). We've pre-imported 
the widget types we'll be using, which this 
time are just three: the basic Widget with 
no special behaviour, the ModalView with a 
pop-up behaviour as used last time, and the 
FloatLayout as we will explaine later. Kivy 
has many other pre-built widgets for creating 
GUls, but this time we're going to focus on 
drawing the whole GUI from scratch using 
Kivy's graphics instructions. These comprise 
either vertex instructions to create shapes 
(including rectangles, lines, meshes, and so 
on) or contextual graphics changes (such as 
translation, rotation, scaling, etc), and are able 
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style game. We'll then be able to compile this 
straight to an Android APK that you can use just 
like any other. 

Of course, once you have mastered the 
basic techniques you aren't limited to using 
any particular kind of app, as even on Android 
you can make use of all your favourite Python 
ibraries to make any sort of program you like. 


o be drawn anywhere on your screen and on 
any widget type. 

Before we can do any of this we'll need a class 
or each kind of game object, which we're going 
oO pre-populate with some of the properties 
hat we'll need later to control them. Remember 
rom last time, Kivy properties are special 
attributes declared at class level, which (among 
other things) can be modified via kv language 
and dispatch events when they are modified 
(Fig. 02). 

The Game class will be one big widget 
containing the entire game. We've specifically 
made it a subclass of FloatLayout because 
this special layout is able to position and size 


Once you've mastered Kivy, your imagination 
is the only limit. If you're pretty new to Kivy, 
don't worry, we won't assume that you have 
any pre-existing knowledge. As long as you 
have mastered some of the Python tutorials 
in this book so far, and so have a fairly good 
understanding of the language, you shouldn't 
have any problems following along. 


its children in proportion to its own position 
and size — so no matter where we run it or 
how we resize the window, it will place all the 
game objects appropriately. 

Next we can use Kivy's graphics instructions 
to draw various shapes on our widgets. We'll 
just demonstrate simple rectangles to show 
their locations, though there are many more 
advanced options you might like to investigate. 
In a Python file we can apply any instruction 
by declaring it on the canvas of any widget, an 
example of which is shown in Fig. 03. 

This would draw a red rectangle with the 
same position and size as the player at its 
moment of instantiation — but this has a 


problem, unfortunately, as the drawing is 
static. When we later move the player widget, 
the red rectangle will stay in the same place, 
and the widget will be invisible when it is in its 
real position. 

We could fix this by keeping references to our 
canvas instructions and repeatedly updating 
their properties to track the player, but there's 
actually an easier way to do all of this - we 
can use the Kivy language we introduced last 
time. It has a special syntax for drawing on 
the widget canvas, which we can use to draw 
each of our widget shapes: 


<Player>: 
canvas: 
Color: 
rgba: i, 1, 1, 1 
Rectangle: 


pos: self.pos 
size: self.size 


<Ball>: 
canvas: 
Color: 
rgb: 1, 0.55, @ 
Rectangle: 


pos: self.pos 
size: self.size 


<Block>: 
canvas: 
Color: 
rgb: self.colour 


Rectangle: 
pos: self.pos 
size: self.size 
Color: 
rgb: @.1, 0.1, 0.1 
Line: 
rectangle: 
[self.x, self.y, 
self.width, self.height] 


The canvas declaration is special, underneath 
it we can write any canvas instructions we 
like. Don't get confused, canvas is not a 
widget and nor are graphics instructions 
like Line. This is just a special syntax that is 
unique to the canvas. Instructions all have 
different properties that can be set, like the 
pos and size of the rectangle, and you can 
check the Kivy documentation online for all 
the possibilities. The biggest advantage is 
that although we still declare simple canvas 
instructions, kv language is able to detect 
what Kivy properties we have referred to and 
automatically track them, so when they are 
updated (the widget moves or is resized) the 
canvas instructions move to follow! 


/ 


o Once you have the basic techniques, 
you aren't limited to one app... your 
imagination is the only limit 


from kivy.app import App 

from kivy.uix.widget import Widget 

from kivy.uix.floatlayout import FloatLayout 
from kivy.uix.modalview import ModalView 
__version__ = '0.1' 


class BreakoutApp(App): 
pass 


BreakoutApp().run() 


from kivy.properties import (ListProperty, NumericProperty, 
ObjectProperty, StringProperty) 


class Game(FloatLayout): 
blocks = ListProperty(L]) 
player = ObjectPropertyQ 
ball = ObjectPropertyQ 


class Player(Widget): Ving 
position = NumericProperty(@.5) 
direction = StringProperty(‘none’) 


class Ball(Widget): 


pos_hint_x = NumericProperty(2.5) 
pos_hint_y = NumericProperty(@.3) 
proper_size = NumericProperty(2.) 
velocity = ListProperty([0.1, 2.5]) 


class Block(Widget): lo 
colour = ListProperty([i, 2, 2]) 


from kivy.graphics.context_instructions import Color 
from kivy.graphics.vertex_instructions import Rectangle 


class Player(Widget): 
def __init__(self, **kwargs): 
super(Player, self).__init__@«kwargs) 
with self.canvas: 
Color(i, 2, 8, D # 2 
Rectangle(pos=self.pos, size=self.size 
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L Batelalaliaroaual-e-le)eksale)xele] mere) (el0 lave pe)loler ccxelanaat) 
screen... but they all overlap! We can fix that easily 


You probably noticed we had one of the 
Block’s ‘Color’ instructions refer to its colour 
property. This means that we can change 
the property any time to update the colour 
of the block, or in this case to give each block 
arandom colour (Fig. 04). 

Now that each of our widgets has a graphical 
representation, let’s now tell our Game where to 
place them, so that we can start up the app and 
actually see something there. 


class Game(FloatLayout): 
def setup_blocks(self): 
for y_jump in range(5): 
for x_jump in range(1@): 
block = Block(pos_hint={ 
’x': @.05 + Q.09%x_jump, 
'y’: @.05 + Q.09%y_jump}) 
self.blocks.append(block) 
self.add_widget(block) 


class BreakoutApp(App): 
def build(self): 
g = Game() 
g.setup_blocks() 
return g 


Here we create the widgets we want then use 
add_widget to add them to the graphics tree. Our 
root widget on the screen is an instance of Game 
and every block is added to that to be displayed. 
The only new thing is that every Block 
has been given a pos_hint. All widgets have 
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this special property, and it is used by 
FloatLayouts like our Game to set their 
position proportionate to the layout. 

The dictionary is able to handle 
various parameters, but in this 
case ‘xand ‘y give x and y_ Block 
position as a relative fraction of the 
parent width and height. 

You can run the app now, and this time 
it will add 50 blocks to the Game before 
displaying it on the screen. Each should have 
one of the three possible random colours 
and be positioned in a grid, but you'll now 
notice their sizes haven't been manually set 
so they all overlap. We can fix this by setting 
their size_hint properties — and let's also 
take this opportunity to do the same for the 
other widgets as well (Fig. 05). 

This takes care of keeping all our game 
widgets positioned and sized in proportion 
to the Game containing them. Notice that 
the Player and Ball use references to the 
properties we set earlier, so we'll be able to 
move them by just setting these properties 
and letting kv language automatically update 
their positions. 

The Ball also uses an extra property to 
remain square rather than rectangular, just 
because the alternative would likely look a 
little bit odd. 

We've now almost finished the basic 
graphics of our app! All that remains is to add 
a Balland a Player widget to the Game. 


<Game>: 

ball: the_ball 

player: the_player 

Ball: 

id: the_ball 

Player: 
id: the_player 
You can run the game again now, and should 
be able to see all the graphics working 
properly. Nothing moves yet, but thanks to 
the FloatLayout everything should remain in 
proportion if you resize the game/window. 

Now we just have to add the game 
mechanics. For a game like this you usually 
want to run some update function many times 
per second, updating the widget positions and 
carrying out game logic — in this case collisions 
with the ball (Fig. 06). 

The Clock can schedule any function at 
any time, either once or repeatedly. A function 
scheduled at interval automatically receives the 
time since its last call (dt here), which we've passed 
through to the ball and player via the references 
we created in kv language. It's good practice to 
scale the update (eg ball distance moved) by this 
dt, so things remain stable even if something 
interrupts the clock and updates don't meet 
the regular 1/60s you want. 

At this point we have also added the first steps 
toward handling keyboard input, by binding to 
the kivy Window to call a method of the Player 
every time a key is pressed. We can then finish 
off the Player class by adding this key handler along 
with touch/mouse input. 


class Player(Widget): 
def on_touch_down(self, touch): 
self.direction = ( 
‘right’ if touch.x > self.parent. < 
center_x else ‘left’) 


def on_touch_up(self, touch): 
self.direction = ‘none’ 


def on_key_down(self, keypress, <4 
scancode, xargs): 

if scancode == 275: 
self.direction = ‘right’ 

elif scancode == 276: 
self.direction = ‘left’ 

else: 
self.direction = ‘none’ 


def on_key_up(self, xargs): 
self.direction = ‘none’ 


def update(self, dt): 
dir_dict = {'right': 1, ‘left’: -1, 


y/ 


‘none’: Q} import random 
self.position += (0.5 * dt * dir 


dict[self.directiori)) class Block(Widget): 


def __init__(self, **kwargs): 
super(Block, self).__init__@«kwargs) 
self.colour = random.choice([ 


method for interacting with touch or mouse input, (0.78, 0.28, 2), }0.28, 0.63, 0.28), )0.25, 0.28, 0.78)]) 
they are automatically called when the input ee 


is detected and you can do anything you like in 
response to the touches you receive. In this case 
we set the Player's direction property in response 
to either keyboard and touch/mouse input, and 
use this direction to move the Player when its 
update method is called. We can also add the right 
behaviour for the ball (Fig. 07). 

This makes the ball bounce off every wall by 
forcing its velocity to point back into the Game, 
as well as bouncing from the player paddle — 
but with an extra kick just to let the ball speed <Ball>: 
change. It doesn't yet handle any interaction 


These on_touch_ functions are Kivy's general 


<Block>: 
size_hint: 0.29, 2.05 


anvaS part 


<Player>: 
size_hint: 0.1, 0.025 
pos_hint: {'x': self.position, ‘y’: 2.1} 


Canvas Ppa 


i 


pos_hint: {'x': self.pos_hint_x, ‘y': self.pos_hint_y} 


with the blocks or any win/lose conditions, size_hint: None, None 

but it does try to call Game.lose() if the proper_size: 

ball hits the bottom of the player's screen, min(@.03*self.parent.height, 2.03*self.parent.width) 
so let's now add in some game end code to handle size: self.proper_size, self.proper_size 


all of this (Fig. 08). And then add the code in Fig. 09 # ... canvas part 
to your 'breakout.kv ‘file. 

This should fully handle the loss or win, 
opening a pop-up with an appropriate message 
and providing a button to try again. Finally, we 
have to handle destroying blocks when the 
ball hits them (Fig. 10). 

This fully covers these last conditions, checking class Game(Floatlayout): 
collision via Kivy's built-in collide_widget method def update(self, dt): 
that compares their bounding boxes (pos and gelf ball updatetde) 
size). The bounce direction will depend on how far 
the ball has penetrated, as this will tell us how it 


from kivy.clock import Clock 
from kivy.core.window import Window 
from kivy.utils import platform 


self.player.update(dt) 


first collided with the Block. def start(self, *args): 

So there we have it, you can run the code to Clock.schedule_interval(self.update, 1./60.) 
play your simple Breakout game. Obviously it's 
very simple right now, but hopefully you can def stop(self): 
see lots of different ways to add whatever extra Clock.unschedule(self.update) 
behaviour you like — you could add different 
types of blocks and power-ups, a lives system, def reset(self): 
more sophisticated paddle/ball interaction, or for block in self.blocks: 
even build a full game interface with a menu and self.remove_widget (block) 
settings screen as well. self.blocks = [] 

We're just going to finish showing one cool thing self.setup_blocks() 


self.ball.velocity = [random.random(), 2.5] 


that you can already do — compile your game for A 
self.player.position = 2.5 


Android! Generally speaking you can take any Kivy 
app and turn it straight into an Android APK that 
will run on any of your Android devices. You can 
even access the normal Android API to access 
hardware or OS features such as vibration, 
sensors or native notifications. 

We'll build for Android using the Buildozer tool, 


class BreakoutApp(App): 
def build(self): 
g = Game() 
if platform() != ‘android’: 
Window. bind(on_key_down=g.player.on_key_down) 
Window. bind(on_key_up=g.player.on_key_up) 


and a Kivy sister project wrapping other build g.reset() 
tools to create packages on different systems. Clock.schedule_once(g.start, 2) 
This takes care of downloading and running the return g 


Android build tools (SDK, NDK, etc) and Kivy's 
Python-for-Android tools that create the APK. 
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class Ball(Widget) 
def update(self, dt): 

self.pos_hint_x += self.velocity[2] * dt 

self.pos_hint_y += self.velocity[1] * dt 

if selfiright > self.parent.right: # Bounce from right 
self.velocity[2] = -1 * abs(self.velocity[2]) 

if self.x < self.parent.x: # Bounce from left 
self.velocity[2] = abs(self.velocity[2]) 

if self.top > self.parent.top: # Bounce from top 
self.velocity[1] = -1 * abs(self.velocity[1]) 

if self.y < self.parent.y: # Los m 
self.parent.lose() C 1 y 

self.bounce_from_player(self. parent.player 


at bo 


t implementec 


def bounce_from_player(self, player): 
if self.collide_widget(player): 
self.velocity[1] = abs(self.velocity[1]) 
self.velocity[0] += ( 
@.1 * ((self.center_x - player.center_x) / 
player.width)) 


class GameEndPopup(ModalView): 
message = StringProperty() 
game = ObjectProperty() 


class Game(Widget): 
def lose(self): 
self.stopQ 
GameEndPopup(message=' [color=#ff@00@]You lose![/color]’, 
game=self).open() 


def win(self): # Not called yet, but we’ll need it later 
self.stopQ 
GameEndPopup(message=' [color=#00ff0@]You win![/color]'’, 
game=self).open() 


<GameEndPopup>: 
size_hint: 2.8, 2.8 
auto_dismiss: False # Don’t close if player clicks outside 
BoxLayout: 
orientation: ‘vertical’ 
Label: 


text: root.message 
font_size: 62 
markup: True 
halign: ‘center’ 
Button: 
size_hint_y: None 
height: sp(82) 
text: ‘Play again?’ 
font_size: 60 
on_release: root.game.start(); root.dismiss() 
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Here you will be needing some basic 
dependencies, which can be installed with 
ease just by using your distro's normal 
repositories. The main ones to use are 
OpenJDK7, zlib, an = up-to-date = Cython, 
and Git. If you are using a 64-bit distro you will also 
be in need of 32-bit compatibility libraries for zlib, 
libstdc++, as well as libgec. You can then go on and 
download and install Buildozer: 


git clone git://github.com/kivy/buildozer 
cd buildozer 
sudo python2.7 setup.py install 


When youre done with that part you 
can then go on and navigate to your 
Kivy app, and you'll have to name the main code file 
‘main.py’, this is the access point that the Android 
APK will expect. Then: 


buildozer init 


This creates a ‘buildozer.spec’ file, a settings file 
containing all the information that Buildozer needs 
to create your APK, from the name and version to 
the specific Android build options. We suggest that 
you check through the whole file just to see what's 
available but most of the default settings will be 
fine, the only thing we suggest changing is (Fig. 11). 

There are various other options you will often 
want to set, but none are really all that vital right 
now, so you're able to immediately tell Buildozer to 
build your APK and get going! 


buildozer android debug 


This will take some time, so be patient and it will 
work out fine. When you first run it, it will download 
both the Android SDK and NDK, which are large 
(at least hundreds of megabytes) but vital to the 
build. It will also take time to build these and to 
compile the Python components of your APK. A lot 
of this only needs to be done once, as future builds 
will take a couple of minutes if you change the 
buildozer.spec, or just a few seconds if you've only 
changed your code. 

The APK produced is a debug APK, and you can 
install and use it but there are extra steps if you 
want to fully digitally sign it so that it can be posted 
on the Play store. This isn't hard, and Buildozer 
can do some of the work, but you can check the 
documentation online for full details. 

Assuming everything goes fine (it should!), 
your Android APK will be in a newly created 'bin' 
directory with the name ‘KivyBreakout-0.1-debug. 
apk’. You can send it to your phone any way you 
like (eg email), though you may need to enable 
application installation from unknown sources in 
your Settings before you can installit. 


self.parent.do_layout() 
self.parent.destroy_blocks(self) 


class Game( ): 
def (elf, ): 
i, block enumerate(self.blocks): 
ball.collide_widget(block): 
y_overlap = ( 
ball.top - block.y ball.velocity[1] 
else block.top - ball.y) / block.size_hint_y 
x_overlap = ( 
ball.right - block.x ball.velocity[2] > 
else block.right - ball.x) / block.size_hint_x 
x_overlap < y_overlap: 
ball.velocity[2] 


ball.velocity[1] 


+ self.remove_widget(block) 
self.blocks.pop(i) 
+ len(self.blocks) 
self.win() 


aa 


ay title = Kivy Breakout 
package.name = breakout 


J fullscreen 
log_level 


Your game should run on any modern Android device... you 4 
can even build a release version and publish to an app store! 
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Making web apps with Python 


Python provides quick and easy way to build 
applications, including web apps. Read on to find out 
how to use it to build a feature-complete web app 


Resources 
Python 2.7: 


https://www.python.org/download/releases/2.7/ 
Django version 1.4: 


https://www.djangoproject.com/ 


62 The Python Book 


Python is known for its simplicity and 
capabilities. At this point it is so advanced 
that there is nothing you cannot do with 
Python, and conquering the web is one of the 
possibilities. When you are using Python for web 
development you get access to a huge catalogue 
of modules and community support — make the 
most of them. 

Web development in Python can be done 
in many different ways, right from using the 


plain old CGI modules to utilising fully groomed 
web frameworks. Using the latter is the most 
popular method of building web applications 
with Python, since it allows you to build 
applications without worrying about all that 
low-level implementation stuff. There are many 
web frameworks available for Python, such 
as Django, TurboGears and Web2Py. For this 
tutorial we will be using our current preferred 
option, Django. 


O Creating the Django Project 
magazine issue tracker 

The django-admin.py file is used to create new 

Django projects. Let’s create one for our issue 

tracker project... 

In Django, a project represents the site and 
its settings. An application, on the other hand, 
represents a specific feature of the site, like 
blogging or tagging. The benefit of this approach 
is that your Django application becomes 
portable and can be integrated with other 
Django sites with very little effort. 
$ django-admin.py startproject 
ludIssueTracker 


A project directory will be created. This will also 
act as the root of your development web server 
that comes with Django. Under the project 
directory you will find the following items... 
manage.py: Python script to work with your 
project. 

ludissueTracker: A python package (a directory 
with __init__.py file) for your project. This 
package contains your project’s settings and 
configuration data. 
ludlssueTracker/settings.py: This file contains 
all the configuration options for the project. 
ludissueTracker/urls.py: This file contains 
various URL mappings. 

wsgi.py: An entry-point for WSGl-compatible 
web servers to serve your project. Only useful 
when you are deploying your project. For this 
tutorial we won't be needing it. 


O Configuring the Django project 
settings 

Before we start working on the application, 

let’s configure the Django project as per our 

requirements. 


Database Settings: We will be using SQLite3 
as our database system. 
NOTE: Red text 
updated code. 
‘default’: { 
‘ENGINE’: ‘django. 
db.backends.sqlite3’, 
‘NAME’: ‘ludsite.db3, 


ndicates new code or 


Path settings 
Django requires an absolute path for directory 
settings. But we want to be able to pass in the 
relative directory references. In order to do that 
we will add a helper Python function. Insert the 
following code at the top of the settings. py file: 
import os 
def getabspath(*x): 

return os.path.join(os.path. 
abspath(os.path.dirname(__file__)), 
*xX) 
Now you can update the path options: 
@code 
TEMPLATE_DIRS = ( 

getabspath(‘ templates’ ) 
) 
MEDIA_ROOT = getabspath( ‘media’ ) 


MEDIA_URL = ‘/media/’ 


Nowwewillneed to enable the admin interface 
forour Django site. This is aneat feature of Django 
which allows the automatic creation of an admin 
interface of the site based on the data model. The 
admin interface can be used to add and manage 
content for a Django site. 

Uncomment the following line: 
INSTALLED_APPS = ( 

‘django.contrib. auth’ , 
‘django.contrib.contenttypes’ , 
‘django.contrib.sessions’, 
‘django.contrib.sites’, 
‘django.contrib.messages’ , 
‘django.contrib.staticfiles’, 
‘django.contrib.admin’ , 

# ‘django.contrib.admindocs’ , 


) 
@) Creating ludissues app 


In this step we will create the primary 
app for our site, called ludissues. To do that, we 
will use the manage.py script: 
$ python manage.py startapp 
ludissues 


We will need to enable this app in the config file 

as well: 

INSTALLED_APPS = ( 
"django.contrib.admin’, 
‘ludissues’, 


) 


@) Creating the data model 

This is the part where we define the 
data model for our app. Please see the inline 
comments to understand what is happening. 
From django.db import models: 
# We are importing the user 
authentication module so that we use 


the built 
# in authentication model in this 
app 


from django.contrib.auth.models 
import User 

# We would also create an admin 
interface for our app 

from django.contrib import admin 


# A Tuple to hold the multi choice 
char fields. 

# First represents the field name 
the second one repersents the 
display name 

ISSUE_STATUS_CHOICES = ( 


C'new', ‘'New’), 
('accepted', ’Accepted’'), 
C'reviewed' , ’Reviewed'), 
('started’, Started’), 
C'closed', 'Closed’), 

) 


class Issue(models.Model1): 

# owner will be a foreign key 
to the User model which is already 
built-in Django 

owner = models.ForeignKey(User,n 
ull=True, blank=True) 

# multichoice with defaulting to 


n ” 


new 

status = models.CharField(max_ 
length=25 , choices=ISSUE_STATUS_ 
CHOICES, default='new’) 

summary = models. TextField() 

# date time field which will be 
set to the date time when the record 
is created 

opened_on = models. 
DateTimeField('date opened’, auto_ 
now_add=True) 

modified_on = models. 
DateTimeField('’date modified’, auto_ 
now=True) 


def name(self): 
return self.summary. 
split('\n',1)(0] 


# Admin front end for the app. We 

are also configuring some of the 

# built in attributes for the admin 

interface on 

# how to display the list, how it 

will be sorted 

# what are the search fields etc. 

class IssueAdmin(admin.ModelAdmin) : 
date_hierarchy = 'opened_on' 
list_filter = ('status’, 'owner’) 
list_display = ('id’,'name','sta 

tus’, ‘owner’, 'modified_on') 
search_fields = 

['description',’status’] 


# register our site with the Django 
admin interface 

admin.site. 

register(Issue, IssueAdmin) 


To have the created data model reflected in the 
database, run the following command: 

$ python manage.py syncdb 

You'll be also asked to create a superuser for it: 


You just installed Django'’s auth 
system, which means you don't have 
any superusers defined. 

Would you like to create one now? 
(yes/no): yes 


0 5 Enabling the admin site 


The admin site is already enabled, 
but we need to enable it in the urls.py file — this 
contains the regex-based URL mapping from 
model to view. Update the urls.py file as follows: 
from django.conf.urls import 
patterns, include, url 
from django.contrib import admin 
admin. autodiscover() 


urlpatterns = patterns(‘’, 
url(r’*admin/’, include(admin. 
site.urls)), 


) 


O Starting the Django web server 
Django includes a built-in web server 
which is very handy to debug and test Django 
applications. Let’s start it to see how our admin 
interface works... 
To start the web server: 
$ python manage.py runserver 


If you do not have any errors in your code, the 
server should be available on port 8000. To 
launch the admin interface, navigate your 
browser to http://localhost:8000/admin. 

You will be asked to log in here. Enter the 
username and password that you created while 
syncing the database. 


Django administration 


Username: max 


PaSSWOrd: seseee 


Log in 


m Admin login screen 


After logging in, you will notice that all the apps 
installed in your project are available here. We are 
only interested in the Auth and Ludlssues app. 

You can click the +Add to add a record. Click 
the Add button next to Users and add a few 
users to the site. 

Once you have the users inside the system, 
you can now add a few issues to the system. 


/ 


 — 
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Site administration 


m Admin homepage 


Click the Add button next to Issues. Here you 
will notice that you can enter Owner, Status 
and Summary for the issue. But what about 
the opened_on and modified_on field that 
we defined while modelling the app? They 
are not here because they are not supposed 
to be entered by the user. opened_on will 
automatically set to the date time it is created 
and modified_on will automatically set to the 
date time on which an issue is modified. 

Another cool thing is that the owner field is 
automatically populated with all the users inside 
the site. 

We have defined our list view to show ID, 
name, status, owner and ‘modified on’ in the 
model. You can get to this view by navigating to 
http://localhost:8000/admin/ludissues/issue/. 


Home >» Ludissues » Issues » Add Je 
Add issue 
ve: NS 
max 
mcdza 
Status: 
allen 
danwest 
Summary: 


@ The ‘Add issue’ menu 


Select issue to change 


«! ew 


@ The list view for issues 
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07 Creating the public user interface 
for ludissues 
At this point, the admin interface is working. But 
we need a way to display the data that we have 
added using the admin interface. But there is no 
public interface. Let’s create it now. 
We will have to begin by editing the main 

urls.py (ludissueTracker/urls.py). 
urlpatterns = patterns(‘’, 

(r’*’ ,include(‘ludissues. 
UBpLS2 i 

(r’*admin/’, include(admin. site. 
urls)), 
) 


This ensures that all the requests will be 
processed by ludissues.urls first. 
@) Creating ludissues.url 

Create a urls.py file in the app directory 
(ludissues/urls.py) with the following content: 
from django.conf.urls import 
patterns, include, url 


# use ludissues model 
from models import ludissues 


# dictionary with all the objects in 

ludissues 

info = { 
‘queryset’:ludissues.objects. 

allQ, 

3 


# To save us writing lots of python 
code 

# we are using the list_detail 
generic view 


#list detail is the name of view we 
are using 

urlpatterns = patterns( ‘django. 
views. generic. list_detail’, 
#issue-list and issue-detail are the 


Recs mee (Nenge pacers beg one 


template names 

#which will be looked in the default 

template 

#directories 
url(r’*$’ ,’object_ 

list’ ,info,name=’issue-list’), 
url(r’*(?P<object_ 

id>\d+)/$’ ,’object_ 

detail’ , info, name=’ issue-detail’), 


) 


To display an issue list and details, we are using 
a Django feature called generic views. In this 
case we are using views called list and details. 
This allow us to create an issue list view and 
issue detail view. These views are then applied 
using the issue_list.html and issue_detail.html 
emplate. In the following steps we will create 
he template files. 


09 Setting up template and media 
directories 

n this step we will create the template and 
media directories. We have already mentioned 
he template directory as 

TEMPLATE_DIRS = ( 

getabspath( ‘templates’ ) 


) 


Which translates to ludissueTracker/ 
udlissuelracker/templates/ Since we will be 
accessing the templates from the ludissues 
app, the complete directory path would be 
udlssueTracker/ludissueTracker/templates/ 
udissues. Create these folders in your 
project folder. 

Also, create the directory ludlssueTracker/ 
udlssueTracker/media/ for holding the CSS 
file. Copy the style.css file from the resources 
directory of the code folder. 

To serve files from this folder we need to make 
it available publicly. To do that, open settings.py 
and add the following lines in ludlssueTracker/ 
udlssueTracker/urls.py: 

from django.conf.urls import 
patterns, include, url 

from django.conf import settings 

# Uncomment the next two lines to 
enable the admin: 

from django.contrib import admin 
admin. autodiscover() 


urlpatterns = patterns(‘’, 

(r’*’ ,include(‘ludissues. 
urls’)), 

(r’“*admin/’, include(admin. site. 


urls)), 

(r’ *media/ 
(?P<path>.*)$’ , django. views.static. 
serve’, 

{‘document_root’:settings. 
MEDIA_ROOT}) 

) 


1 Creating the template files 
Templates will be loaded from the 
ludissueTracker/ludlssueTracker/templates 
directory. In Django, we start with the 
ludissueTracker/ludlssueTracker/templates/ 
base.html template. Think of it as the master 
template which can be inherited by slave ones. 


<!DOCTYPE html PUBLIC “-//W3C//DTD 
XHTML Strict//EN” 
“ HYPERLINK “http: //www.w3.org/ 
TR/xhtm11/DTD/xhtml1-strict.dtd” 
http: //www.w3.org/TR/xhtml1/DTD/ 
xhtml1-strict.dtd”> 
<html> 
<head> 
<title>{% block title %}{% 
endblock %}LUD Issues</title> 
<link rel="stylesheet” 
href="{{ MEDIA_URL }}style.css” 
type="text/css” media=”screen” /> 
</head> 


<body> 
<div id=”hd”> 
<h1>LUD Issue 
Tracker</span></h1> 
</div> 
<div id=’mn”> 
<ul> 
<li><a 


href="{% url issue-list %}” 
class=”"sel”>View Issues</a></1i> 


<li><a 
href=”"/admin/”>Admin Site</a></1li> 
</ul> 
</div> 
<div id=”bd”> 


{% block content %} 
{% endblock %} 
</div> 
</body> 
</html> 


{{variablename }} represents a Django variable. 
(% block title %} represents blocks. Contents 
of a block are evaluated by Django and are 
displayed. These blocks can be replaced by the 
child templates. 


Admin Site 


ssue Description 


1 There is a problem in that module. 


lud issue tracker 


Status Owner 
now max 
accepted ana 

staned samfisher 
started Gumbdiedore 
started samfisher 


l™ The magazine Issue Tracker in action — list of issues 


Now we need to create the issue_list.html 
template. This template is responsible for 
displaying all the issues available in the system. 


{% extends ‘base.html’ %} 
{% block title %}View Issues - {% 
endblock %} 
{% block content %} 
<table cellspacing=”0” 
class=”column-options”> 
<tr> 
<th>Issue</th> 
<th>Description</th> 
<th>Status</th> 
<th>Owner</th> 
</tr> 
{% for issue in object_list %} 
<tr> 
<td><a href="{% url issue- 
detail issue.id %}”>{{ issue.id }}</ 
a></td> 
<td><a href="{% url issue- 
detail issue.id %}”>{{ issue.name 
}}</a></td> 
<td>{{ issue.status }}</td> 
<td>{{ issue.owner}}</td> 
</tr> 
{% endfor %} 
</table> 
{% endblock %} 


Here we are inheriting the base.html file that we 
created earlier. {% for issue in object_list %} 
runs on the object sent by the urls.py. Then we 
are iterating on the object_list for issue.id and 
issue.name. 

Now we will create issue_detail.html. This 
template is responsible for displaying the detail 
view of acase. 


ludissueTracker/ludissueTracker/templates/ 
ludissues/issue_detail.html 
{% extends ‘base.html’ %} 
{% block title %}Issue #{{ object.id 
}} - {% endblock %} 
{% block content %} 
<h2>Issue #{{ object.id }} <span>{{ 
object.status }}</span></h2> 
<div class=”issue”> 
<h2>Information</h2> 
<div class=”"date”> 
<p class=”cr”>Opened {{ 
object.opened_on }} ago</p> 
<p class=”up”>Last modified 
{{ object.modified_on }} ago</p> 
</div> 
<div class=”clear”>&nbsp; </div> 
<div class=”block w49 right”> 
<p class=”"ass title”>Owner</ 
p> 
<p class=”"ass”>{{ object. 
owner }}</p> 
</div> 
<div class=”clear”>&nbsp; </div> 
<div class=”block”> 
<p class=”"des 
title”>Summary</p> 
<p class="des”>{{ object. 
summary }}</p> 
</div> 
</div> 
{% endblock %} 


And that’s everything! The issue tracker app is 


now complete and ready to use. You can now 
point your browser at localhost:8000 to start 


using the app. 


y/ 
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hon scripts 


1. Runnin 
On most of the UNIX systems, you can run 
Python scripts from the command line. 

$ python mypyprog. py 


2. Running Python 
programs from 
Python interpreter 


The Python interactive interpreter makes it 
easy to try your first steps in programming and 
using all Python commands. You just issue each 
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command at the command prompt (>>>), one by 
one, and the answer is immediate. 


$ python 

kunal@ubuntu:~$ python 

Python 2.6.2 (release26-maint, Apr 

19 2009, 01:56:41) 

[GCC 4.3.3] on linux2 

Type “help”, “copyright”, “credits” 
or “license” for more information. 

>>> <type commands here> 


Python is a programming language that lets you work more quickly and 
integrate your systems more effectively. Today, Python is one of the most 
popular programming languages in the open source space. Look around 
and you will find it running everywhere, from various configuration tools 
to XML parsing. Here is the collection of 50 gems to make your Python 
experience worthwhile... 


t is also important to remember that Python 
takes tabs very seriously — so if you are 
receiving any error that mentions tabs, correct 
the tab spacing. 


3. Dynamic typing 


n Java, C++, and other statically typed 
anguages, you must specify the data type of 
the function return value and each function 
argument. On the other hand, Python is 
a dynamically typed language. In Python 
you never have to explicitly specify the data 
type of anything. Based on what value you 
assign, Python will keep track of the data 
type internally. 


4. Python statements 


Python uses carriage returns to separate 
statements, and a colon and indentation to 
separate code blocks. Most of the compiled 
programming languages, such as C and C++, use 
semicolons to separate statements and curly 
brackets to separate code blocks. 


5. == and = operators 

Python uses ‘==’ for comparison and ‘=’ for 
assignment. Python does not support inline 
assignment, so there’s no chance of accidentally 
assigning the value when you actually want to 
compare it. 


6. Concatenating strings 


You can use ‘+’ to concatenate strings. 
>>> print ‘kun’+’al’ 


kunal 
7.The __init__ method 
The __init_. method is run as soon as 


an object of a class is instantiated. The 
method is useful to do any _ initialization 
you want to do with your object. The 
__init__ method is analogous to a constructor in 
C++, C# or Java. 


class Person: 
def __init__(self, name): 
self.name = name 
def sayHi(self): 
print ‘Hello, my name is’, self.name 
p = Person( ‘Kunal’ ) 
p.sayHi() 


[~/src/python $:] python initmethod.py 
Hello, my name is Kunal 


8. Modules 


To keep your programs manageable as they 
grow in size, you may want to break them up into 
several files. Python allows you to put multiple 
function definitions into a file and use them as a 
module that can be imported into other scripts and 
programs. These files must have a .py extension. 


# file my_function.py 
def minmax(a,b): 

if a <=b: 

min, max = a, b 
else: 

min, max = b, a 
return min, max 
Module Usage 

import my_function 


x,y = my_function.minmax(25, 6.3) 


9. Module defined names 
Example: 


The built-in function ‘dir()’ can be used to find 
out which names a module defines. It returns a 
sorted list of strings. 

>>> import time 

>>> dir(time) 

[iSadoctad: “sshilecee eenames a2, 
“__package__’, ‘accept2dyear’ , 
‘altzone’, ‘asctime’, ‘clock’, 
‘ctime’, ‘daylight’, ‘gmtime’, 
‘localtime’, ‘mktime’, ‘sleep’, 
‘strftime’, ‘strptime’, ‘struct_ 
time’, ‘time’, ‘timezone’, ‘tzname’, 
‘tzset’ ] 


10. Module internal 
documentation 


You can see the internal documentation (if 
available) of a module name by looking at 
; 00G:., 

>>> import time 

>>> print time.clock.__doc__ 

clock() -> floating point number 

This example returns the CPU time or real time 
since the start of the process or since the first 
call to clock(). This has as much precision as the 
system records. 


11. Passing arguments 
toa Python script 


Python lets you access whatever you have passed 
to a script while calling it. The ‘command line’ 
content is stored in the sys.argv list. 

import sys 

print sys.argv 


12. Loading modules or 
commands at startup 


You can load predefined modules’ or 
commands at the startup of any Python 
script by using the environment variable 
$PYTHONSTARTUP. You can set environment 
variable $PYTHONSTARTUP to a file which 
contains the instructions load necessary 
modules or commands . 


13. Converting a string 
to date object 


You can use the function ‘DateTime’ to convert a 
string to a date object. 


from DateTime import DateTime 


dateobj = DateTime(string) 
14. Converting a list 
toa string for display 


You can convert a list to string in either of the 


aes ways. 


>>> mylist = [‘spam’, ‘ham’, ‘eggs’ ] 
>>> print ‘, ‘.join(mylist) 
spam, ham, eggs 


>>> print ‘\n’.join(mylist) 
spam 
ham 
eggs 


15. Tab completion 


in Python interpreter 


You can achieve auto completion inside Python 
interpreter by adding these lines to your .pythonrc 
file (or your file for Python to read on startup): 
import rlcompleter, readline 
readline.parse_and_bind( ‘tab: complete’) 
This will make Python complete partially typed 
function, method and variable names when you 
press the Tab key. 


16. Python 
documentation tool 


You can pop up a graphical interface for searching 
the Python documentation using the command: 

$ pydoc -g 

You will need python-tk package for this to work. 


17. Python 
documentation server 


You can start an HTTP server on the given port on 
the local machine. This will give you a nice-looking 
access to all Python documentation, including 
third-party module documentation. 

$ pydoc -p <portNumber> 


18. Python development 


software 

There are plenty of tools to help with Python 
development. Here are a few important ones: 
IDLE: The Python built-in IDE, with 
autocompletion, function signature popup help, 
and file editing. 

Another enhanced Python shell with 
tab-completion and other features. 
Eric3: A GUI Python IDE with autocompletion, 
class browser, built-in shell and debugger. 


/ 


WingIDE: Commercial Python IDE with 
free licence available to open-source 
developers everywhere. 
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Built-in 
modules 


19. Executing functions 
at the time of Python 
interpreter termination 


You can use ‘atexit’ module to execute functions 
at the time of Python interpreter termination. 


def sum(): 
print(4+5) 
def message(): 
print(“Executing Now”) 
import atexit 
atexit.register(sum) 
atexit.register (message) 


Executing Now 
9 


20. Converting from integer 
to binary, hexadecimal 
and octal 


Python provides easy-to-use functions — bin(), 
hex() and oct() — to convert from integer to binary, 
decimal and octal format respectively. 


>>> bin(24) 
§0b11000’ 
>>> hex(24) 
“0x18? 

>>> oct (24) 
§Q3Q’ 


21. Converting any 
charset to UTF-8 


You can use the following function to convert any 
charset to UTF-8. 
data.decode(“input_charset_here”). 
encode (‘utf-8’) 


22. Removing 
duplicates from lists 


If you want to remove duplicates from a list, 
just put every element into a dict as a key (for 
example with ‘none’ as value) and then check 
dict.keys(). 
from operator import setitem 
def distinct(1): 
el = 
map(setitem, (d,)*len(1), 1, []) 
return d.keys() 
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23. Do-while loops 
Since Python has no do-while or do-until loop 
constructs (yet), you can use the following 
method to achieve similar results: 
while True: 

do_something() 

if condition(): 

break 


24. Detecting system 
platform 


To execute platform-specific functions, it is very 
useful to detect the platform on which the Python 
interpreter is running. You can use ‘sys.platform’ 
to find out the current platform. 


>>> import sys 

>>> sys.platform 
“Linux2’ 

On Mac OSX Snow Leopard 
>>> import sys 

>>> sys.platform 
‘darwin’ 


25. Disabling and enabling 
garbage collection 


Sometimes you may want to enable or disable 
the garbage collector at runtime. You can 
use the ‘gc’ module to enable or disable the 
garbage collection. 


>>> import gc 
>>> gc.enable 
<built-in function enable> 
>>> gc.disable 
<built-in function disable> 


26. Using C-based modules 
for better performance 


Many Python modules ship with counterpart 
C modules. Using these C modules will 
give a significant performance boost in 
complex applications. 


cPickle instead of Pickle, cStringI0O 
instead of StringIO . 


27. Calculating maximum, 
minimum and sum 
out of any list or iterable 


You can use the following built-in functions. 
Returns the largest element in the list. 
Returns the smallest element in the list. 


sum: This function returns the sum of all 
elements in the list. It accepts an optional 
second argument: the value to start with when 
summing (defaults to 0). 


28. Representing 
fractional numbers 


Fraction instance can be created using the 
following constructor: 
Fraction([numerator 
[,denominator]]) 


29. Performing 
math operations 


The ‘math’ module provides a plethora of 
mathematical functions. These work on integer 
and float numbers, except complex numbers. 
For complex numbers, a separate module is 
used, called ‘emath’. 


math.acos(x): Return arc cosine of 
xe 
math.cos(x): Returns cosine of x. 
math.factorial(x) : Returns x 
factorial. 


30. Working with arrays 

The ‘array’ module provides an efficient way to 
use arrays in your programs. The ‘array’ module 
defines the following type: 

array(typecode [, initializer]) 
Once you have created an array object, say 
myarray, you can apply a bunch of methods to it. 
Here are a few important ones: 
myarray.count(x): Returns the 
number of occurrences of x in a. 
myarray.extend(x): Appends x at the 
end of the array. 

myarray.reverse(): Reverse the 
order of the array. 


31. Sorting items 

The ‘bisect’ module makes it very easy to keep 
ists in any possible order. You can use the 
following functions to order lists. 
bisect.insort(list, item [, low [, 
high]]) 

nserts item into list in sorted order. If item is 
already in the list, the new entry is inserted to 
he right of any existing entries. 
bisect.insort_left(list, item [, low 
[, high]]) 

nserts item into list in sorted order. If item is 
already in the list, the new entry is inserted to 
he left of any existing entries. 


32. Using regular 
expression-based 
search 


The ‘re’ module makes it very easy to use regxp- 
based searches. You can use the function 
‘re.search() with a regexp-based expression. 
Check out the example below. 


>>> import re 
>>> s = “Kunal is a bad boy” 
>>> if re.search(“K”, s): print 
“Match!” # char literal 
Match! 
>>> if re.search(“[@A-Z]”, s): print 
“Match!” # char class 

. # match either at-sign or capital 
letter 
Match! 
>>> if re.search(“\d”, s): print 
“Match!” # digits class 


33. Working with bzip2 (.bz2) 
compression format 


You can use the module ‘bz2’ to read and write 
data using the bzip2 compression algorithm. 


bz2.compress() : For bz2 
compression 
bz2.decompress() : For bz2 
decompression 


# File: bz2-example.py 

import bz2 

MESSAGE = “Kunal is a bad boy” 
compressed_message = bz2. 
compress (MESSAGE) 
decompressed_message = bz2. 
decompress (compressed_message) 
print “original:”, repr (MESSAGE) 
print “compressed message:”, 
repr (compressed_message) 

print “decompressed message:”, 
repr (decompressed_message) 


[~/src/python $:] python bz2- 
example. py 

original: ‘Kunal is a bad boy’ 
compressed message: ‘BZh91AY&SY\xc4\ 
X@FG\x98\x00\x00\x02\x15\x80G@\x00\ 
xQQ\x084%\x8a_ \xQQ’\x@Q\xOc\x84\r\ 
x@3C\xa2\xb@\xd6s\xa5\xb3\x19\x00\ 
xf8\xbb\x92)\xc2\x84\x86 z<\xcQ’ 
decompressed message: ‘Kunal is a 
bad boy’ 


34. Using SQLite database 
with hon 


SQLite is fast becoming avery popular embedded 
database because of its zero configuration 
needed, and superior levels of performance. You 
can use the module ‘sqlite?’ in order to work with 
SQLite databases. 


>>> import sqlite3 
>>> connection = sqlite.connect(‘test. 
db’) 
>>> curs = connection.cursor() 
>>> curs.execute(‘’’create table item 
... (id integer primary key, itemno 
text unique, 

. scancode text, descr text, price 
real)’’’) 
<sqlite3.Cursor object at 0x1004a2b30> 


35. Working with zip files 

You can use the module ‘zipfile’ to work with 
zip files. 

zipfile.ZipFile(filename [, mode L, 
compression [,allowZip64]]]) 

Open a zip file, where the file can be either a path 
toa file (a string) or a file-like object. 
zipfile.close(){ 

Close the archive file. You must call ‘close()’ before 
exiting your program or essential records will not 
be written. 

zipfile.extract(member[, pathL, 
pwd]]) 

Extract a member from the archive to the current 
working directory; ‘member’ must be its full 
name (or a zipinfo object). Its file information 
is extracted as accurately as possible. ‘path’ 
specifies a different directory to extract to. 
‘member’ can be a filename or a zipinfo object. 
‘owd’ is the password used for encrypted files. 


36. Using UNIX-style 
wildcards to search 
for filenames 


You can use the module ‘glob’ to find all the 
pathnames matching a pattern according to the 
rules used by the UNIX shell. *, ?, and character 
ranges expressed with [] willbe matched. 


>>> import glob 

>>> glob.glob(‘./L0-9].*’) 
Col er, P20 tae? || 

>>> glob.glob(‘*.gif’) 
lo ifeeCanGn camel 

>>> glob.glob(‘?.gif’) 

Eo ear? Tl 


) 


37. Performing basic file 
operations (copy, delete 
and rename) 


You can use the module ‘shutil’ to perform basic 
file operation at a high level. This module works 
with your regular files and so will not work with 
special files like named pipes, block devices, and 
soon. 

shutil.copy(src,dst) 

Copies the file src to the file or directory dst. 
shutil.copymode(src, dst) 

Copies the file permissions from src to dst. 
shutil.move(src,dst) 

Moves a file or directory to dst. 
shutil.copytree(src, dst, symlinks 
[,ignore]]) 

Recursively copy an entire directory at src. 
shutil.rmtree(path [, ignore_errors 
[, onerror]]) 

Deletes an entire directory. 


38. Executing UNIX 
commands from Python 


You can use module commands to execute UNIX 
commands. This is not available in Python3 - 
instead you need to use the module ‘subprocess’. 


>>> import commands 
>>> commands. getoutput(‘1s’) 
‘bz2-example.py\ntest. py’ 


39. Reading environment 
variables 


You can use the module ‘os’ to gather operating- 
system-specific information: 


>>> import os 
>>> os.path <module ‘posixpath’ 
from ‘/usr/lib/python2.6/posixpath. 


pyc’>>>> os.environ {‘LANG’: ‘en_ 
IN’, ‘TERM’: ‘xterm-color’, ‘SHELL’: 
‘/bin/bash’, ‘LESSCLOSE’ : 


‘/usr/bin/lesspipe %s %s’, 
‘XDG_SESSTION_COOKIE’ : 
§925c4644597c791c704656354adf56d6- 
1257673132.347986-1177792325’ , 


OGnILWIL? 2 Sal? .. SSSinLInn?? s Sele 
pts/2’, ‘PWD’: ‘/home/kunal’ , 
‘LESSOPEN’: ‘| /usr/bin 
lesspipe 

ee } 

>>> os.name 

‘posix’ 

>>> os.linesep 

‘\n’ 
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40. Sending email 

You can use the module ‘smtplib’ to send email 
using an SMTP (Simple Mail Transfer Protocol) 
client interface. 

smtplib.SMTP([host [, port]]) 


import smtplib 

# Use your own to and from email 
address 

fromaddr = ‘kunaldeo@gmail.com’ 


toaddrs = ‘toemail@gmail.com’ 
msg = ‘I am a Python geek. Here is 
the proof.!’ 


# Credentials 
# Use your own Google Mail 
credentials while running the 


program 
username = ‘kunaldeo@gmail.com’ 
password = ‘xXxXXXXxx’ 


# The actual mail send 

server = smtplib.SMTP(‘smtp.gmail. 
com: 587’) 

# Google Mail uses secure 
connection for SMTP connections 
server.starttls() 

server. login(username, password) 
server.sendmail(fromaddr, toaddrs, 


msg) 
server.quit() 


41. Accessing 


FTP server 
‘ftplib’ is a fully fledged client FTP module for 
Python. To establish an FTP connection, you 
can use the following function: 
ftplib.FTP(Lhost [, user [, passwd 
[, acct [, timeout]]]]]) 


host = “ftp.redhat.com” 
username = “anonymous” 

password = “kunaldeo@gmail.com” 
import ftplib 

import urllib2 

ftp_serv = ftplib. 

FTP(host, username, password) 

# Download the file 

u = urllib2.urlopen (“ftp:// 
ftp.redhat.com/pub/redhat/linux/ 
README” ) 

# Print the file contents 

print (u.read()) 


[~/src/python $:] python 
ftpclient.py 
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Older versions of Red Hat Linux have been moved 
to the following location: ftp://archive.download. 
redhat.com/pub/redhat/linux/ 


42. Launching a webpage 
with the default web 
browser 


The ‘webbrowser’ module provides a convenient 
way to launch webpages using the default 
web browser. 


>>> import webbrowser 

>>> webbrowser .open(‘http://google. 
co.uk’) 

True 


43. Creating secure hashes 
The ‘hashlib’ module supports a plethora of 
secure hash algorithms including SHA1, SHA224, 
SHA256, SHA384, SHA512 and MD5. 


>>> import hashlib 

# shal Digest 

>>> hashlib.shal(“MI6 Classified 
Information 07”) .hexdigest() 
“e224b1543f229cc@cb935aleb9593 
18ba1b20c85’ 

# sha224 Digest 

>>> hashlib.sha224(“MI6 Classified 
Information 07”) .hexdigest() 
*3d01e2F741000b0224084482f905e9b7b97 
7a59b480990ea8355e2c0’ 

# sha256 Digest 

>>> hashlib.sha256(“MI6 Classified 
Information 07”) .hexdigest() 
‘2fdde5733f5d47b672fcb39725991c89 
b2550707cbf4c6403e fdb33b1c19825e’ 

# sha384 Digest 

>>> hashlib.sha384(“MI6 Classified 
Information 007”) .hexdigest() 
*5c4914160f03dfbd19e14d3ecle74bd8b99 
dc192edc138aaf7682800982488daaf540be 
9e0@e50fc3d3a65c8b6353572d’ 

# sha512 Digest 

>>> hashlib.sha512(“MI6 Classified 
Information 07”) .hexdigest() 
“a704ac3dbef6e8234578482a31d5ad29d25 
2¢822d1f4973f49b850222edcc0a29bb89077 
8aea807a0a48ee4ff8bb18566140667fbaft7 
3aldclff192febc713d2’ 

# MD5 Digest 

>>> hashlib.md5(“MI6 Classified 
Information 07”) .hexdigest() 
*8e2f1c52ac146f1a999a670c826F7126’ 


44. Seeding random 
numbers 


You can use the module ‘random’ to generate 
a wide variety of random numbers. The most 
used one is ‘random.seed([x])’. It initialises 
the basic random number generator. If x is 
omitted or None, current system time is used; 
current system time is also used to initialise the 
generator when the module is first imported. 


45. Working with CSV 
(comma-separated 
values) files 


CSV files are very popular for data exchange over 
the web. Using the module ‘csv’, you can read and 
write CSV files. 


import csv 
# write stocks data as comma- 
separated values 
writer = csv.writer(open( ‘stocks. 
csv’, ‘wb’, buffering=0)) 
writer.writerows(L 
(‘GOOG’, ‘Google, Inc.’, 505.24, 0.47, 
@.09), 
(‘YHOO’, ‘Yahoo! Inc.’, 27.38, 0.33, 
22) e 
(‘CNET’, ‘CNET Networks, Inc.’, 8.62, 
-@.13, -1.49) 
1) 
# read stocks data, print status 
messages 
stocks = csv.reader(open(‘stocks. 
CSV) 
status_labels = {-1: ‘down’, Q: 
‘unchanged’, 1: ‘up’} 
for ticker, name, price, change, pct 
in stocks: 

status = status_ 
labels[cmp(float(change), @.0)] 

print ‘%s is %s (%s%%)’ % (name, 
status, pct) 


46. Installing third- 
party modules using 
setuptools 


‘setuptools’ is a Python package which lets you 
download, build, install, upgrade and uninstall 
packages very easily. 

To use ‘setuptools’ you will need to install 
from your distribution’s package manager. 
After installation you can use the command 
‘easy_install’ to perform Python package 
management tasks. 


kunal@ubuntu:~$ sudo easy_install 
simplejson 

Searching for simplejson 

Reading http://pypi.python.org/simple/ 
simplejson/ 

Reading http: //undefined.org/ 
python/#simplejson 

Best match: simplejson 2.0.9 
Downloading http://pypi.python. 
org/packages/source/s/simplejson/ 
simplejson-2.0.9.tar.gz#md5=af5e67a39c 
a3408563411d357e6d5e47 

Processing simplejson-2.0.9.tar.gz 
Running simplejson-2.0.9/setup.py 

-q bdist_egg --dist-dir /tmp/easy_ 
install-FiyfNL/simplejson-2.0.9/egg- 
dist-tmp-3YwsGV 

Adding simplejson 2.0.9 to easy- 
install.pth file 

Installed /usr/local/lib/python2.6/ 
dist-packages/simplejson-2.@.9-py2.6- 
linux-i686.egg 

Processing dependencies for simplejson 
Finished processing dependencies for 
simplejson 


47. Logging to system log 

You can use the module ‘syslog’ to write to system 
log. ‘syslog’ acts as an interface to UNIX syslog 
library routines. 


import syslog 
syslog.syslog(‘mygeekapp: started 
logging’) 
oir ey im Ifa? “oe? elle 
b = ‘mygeekapp: I found letter ‘+a 
syslog.syslog(b) 
syslog.syslog(‘mygeekapp: the script 
goes to sleep now, bye,bye!’) 


$ python mylog.py 

$ tail -f /var/log/messages 

Nov 8 17:14:34 ubuntu -- MARK -- 
Nov 8 17:22:34 ubuntu python: 
mygeekapp: started logging 

Nov 8 17:22:34 ubuntu python: 
mygeekapp: I found letter a 

Nov 8 17:22:34 ubuntu python: 
mygeekapp: I found letter b 

Nov 8 17:22:34 ubuntu python: 
mygeekapp: I found letter c 

Nov 8 17:22:34 ubuntu python: 
mygeekapp: the script goes to sleep 
now, bye,bye! 


48. Generating PDF 


documents 


‘ReportLab’ is a very popular module for PDF 
generation from Python. 


$ wget http://ww.reportlab.org/ftp/ 
ReportLab_2_3.tar.gz 

$ tar xvfz ReportLab_2_3.tar.gz 

$ cd ReportLab_2_3 

$ sudo python setup.py install 


FHHHAHHAHHAHESUMMARY INF O#4HHHHAHHEE 
FRB HHH 
#Attempting install of _rl_accel, sgmlop 
& pyHnj 

#extensions from ‘/home/kunal/python/ 


#extensions from ‘/home/kunal/python/ 
ReportLab_2_3/src/rl_addons/renderPM’ 

# installing with freetype version 21 
FRB HHH 
>>> from reportlab.pdfgen.canvas import 
Canvas 

# Select the canvas of letter page size 
>>> from reportlab.lib.pagesizes import 
letter 

>>> pdf = Canvas(“bond.pdf”, pagesize = 
letter) 

# import units 

>>> from reportlab.lib.units import cm, 
mm, inch, pica 

>>> pdf.setFont(“Courier”, 60) 

>>> pdf.setFillColorRGB(1, @, @) 

>>> pdf.drawCentredString(letter[Q] / 2, 
inch * 6, “MI6 CLASSIFIED’) 

>>> pdf.setFont(“Courier”, 40) 

>>> pdf.drawCentredString(letter[0] / 2, 
inch * 5, “For Q07’s Eyes Only”) 

# Close the drawing for current page 
>>> pdf .showPage() 

# Save the pdf page 

>>> pdf. save() 


@image: pdf .png 
@title: PDF Output 


49. Using Twitter API 


You can connect to Twitter using the ‘Python- 
Twitter’ module. 


y/ 


Third-party modules 


$ wget http://python-twitter. 
googlecode.com/files/python-twitter- 
@.6.tar.gz 

$ tar xvfz python-twitter* 

$ cd python-twitter* 

$ sudo python setup.py install 


>>> import twitter 

# Use you own twitter account here 

>>> mytwi = twitter.Api(username=’kunald 
eo’ , password=’ xxxxxx’ ) 

>>> friends = mytwi.GetFriends() 

>>> print Lu.name for u in friends] 
[u’Matt Legend Gemmell’, u’jono wells’, 
u’The MDN Big Blog’, u’Manish Mandal’ , 
u’ iH8snew’ , u’IndianVideoGamer.com’ , 
u’FakeAaron Hillegass’, u’ChaosCode’ , 
u’nileshp’, u’Frank Jennings’,..’] 


50. Doing Yahoo! news 
search 


You can use the Yahoo! search SDK to access 
Yahoo! search APIs from Python. 


$wget http: //developer . yahoo. com/ 
download/files/yws-2.12.zip 

$ unzip yws* 

$ cd ywsx/Python/pYsearchx/ 

$ sudo python setup.py install 


# Importing news search API 

>>> from yahoo.search.news import 
NewsSearch 

>>> srch = NewsSearch(‘YahooDemo’ , 
query=’ London’ ) 

# Fetch Results 

>>> info = srch.parse_results() 
>>> info. total_results_available 
41640 

>>> info. total_results_returned 
10 

>>> for result in info.results: 
... print “’%s’, from %s” % 
(result[‘Title’], result[‘NewsSource’ ]) 


‘Afghan Handover to Be Planned at London 
Conference, Brown Says’, from Bloomberg 
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5013-04-21 14:27:55.333252 client2 has joined. 
2013-04-21 14:27:59.383522 client2 says: Hi 
3013-04-21 14:28:09.799543 client1 says: Hi 
2013-04-21 14:28:19.703694 client1 has quit. 
2013-04-21 14:28:26.727603 Server has quit. 


74 Python for professionals 
Put your skills to professional use 


82 Extensions for XBMC 
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88 Scientific computing 
Get to grips with NumPy 


92 Instant messaging 
Get chatting using Python 


98 Replace your shell 


Use Python for your primary shell 


102 Python for system admins 


How Python helps system administration 


_ “With Python, you can tweak 
and realise your ideal system set-up” 
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PY THON FOR 
PROFESSIONALS 


Python is relied upon by web developers, engineers and 
academic researchers across the world. Here’s how to put your 
Python skills to professional use 
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Work with Python Mf 


System administration 


Get the most out of Python in handling all of the day-to-day 
upkeep that keeps your system healthy 


System administration tasks are some of the most 
annoying things that you need to deal with when you 
have to maintain your own system. Because of this, 
system administrators have constantly been trying to find 
ways to automate these types of tasks to maximise their 
time. They started with basic shell scripts, and then moved 
on to various scripting languages. For a long time, Perl had 
been the language of choice for developing these types 
of maintenance tools. However, Python is now growing in 
popularity as the language to use. It has reached the point 
where most Linux distributions have a Python interpreter 
included in order to run system scripts, so you shouldn't 
have any excuse for not writing your own scripts. 

Because you will be doing a lot system level work, you 
will have most need of a couple of key Python modules. 
The first module is ‘os’. This module provides the bulk of 
the interfaces to interacting with the underlying system. 
The usual first step is to look at the environment your 
script is running in to see what information might exist 
there to help guide your script. The following code gives 
you a mapping object where you can interact with the 
environment variables active right now: 


import os 
os.environ 


You can get a list of the available environment variables 
with the function “os.environs.keys()”, and then access 
individual variables with “os.environs[key]”. These 
environment variables are used when you spawn a 
subprocess, as well. So you will want to change values, 
like the PATH or the current working directory, in order 
for you to run these subprocesses correctly. While there 
is a “putenv” function that edits these values for you, it 
unfortunately does not exist on all systems. So the better 


way to do this is to edit the values directly within the 
environs mapping. 

Another category of tasks you may want to automate 
is when working with files. For example, you can get the 
current working directory with code like 


| cwd = os.getcwd() 
You can then get a list of the files in this directory with 
| os. listdir(cwd) 


You can move around the file system with the function 
“os.chdir(new_path)”. Once you've found the file you are 
interested in, you can open it with “os.open()” and open it 
for reading, writing and/or appending. You can then read 
or write to it with the functions “os.read()” and “os.write()”. 
Once done, you can close the file with “os.close()”. 


Running subprocesses from Python 


The underlying philosophy of Unix is to build small, specialised 
programs that do one job extremely well. You then chain these 
together to build more complex behaviours. There is no reason 
why you shouldn't use the same philosophy within your Python 


scripts. There are several utility programs available to use with 
very little work on your part. The older way of handling this was 
through using functions like “popen()” and “spawnl()” from the 
os module, but a better way of running other programs is by 
using the subprocess module instead. You can then launch a 
program, like ls, by using: 


This provides you with a long file listing for the current 
directory. The function “run()” was introduced in Python 
3.5 and is the suggested way of handling this. If you have an 
older version, or if you require more control than that, then 
you can employ the underlying “popen()” function that we 
mentioned earlier instead. If you want to get the output, you 
can use the following: 


The variable “cmd_output” is a CompletedProcess object that 
contains the return code and a string holding the stdout output. 


Left Python scripts 
enable you to instruct 
and interact with your 
operating system 


Scheduling 
with cron 
QE 


Once you have your script 

all written up, you may want 
to schedule them to run 
automatically without your 
intervention. On Unix systems, 
you can have cron run your 
script on whatever schedule 
is necessary. The utility 
“crontab -l” lists the current 
contents of your cron file, and 
“crontab -e” lets you edit the 
scheduled jobs that you want 
cron to run. 
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Web development 


Python has several frameworks available for all of your 
various web development tasks. We will look at some of the 


more popular ones 


With the content and the bulk of the computing hosted 
on a server, a web application can better guarantee 
a consistent experience for the end user. The popular 
Django framework provides a very complete environment 
of plugins and works on the DRY principle (Don’t Repeat 
Yourself). Because of this, you should be able to build 
your web application very quickly. Since Django is built 
on Python, you should be able to install it with “sudo pip 
install Django”. Most distributions should have a package 
for Django, too. Depending on what you want to do with 
your app, you may need to install a database like MySQL or 
postgresql to store your application data. 

There are Django utilities available to automatically 
generate a starting point for your new project’s code: 


| django-admin startproject newsite 


This command creates a file named “manage.py” and 
a subdirectory named “newsite”. The file “manage.py” 
contains several utility functions you can use to administer 
your new application. The newly created subdirectory 
contains the files “__init__.py”, “settings.py”, “urls.py” and 
“wsgi.py”. These files and the subdirectory they reside in 
comprise a Python package that gets loaded when your 
web site is started up. The core configuration for your site 
can be found in the file “settings.py”. The URL declarations, 
basically a table of contents for your site, are stored in the 
file “urls.py”. The file “wsgi.py” contains an entry point for 
WSGlI-compatible web servers. 

Once your application is done, it should be hosted on a 
properly configured and hardened web server. But, this is 
inconvenient if you are in the process of developing your 
web application. To help you out, Django has a web server 
built into the framework. You can start it up by changing 
directory to the “newsite” project directory and running the 
following command: 


Manipulates 


| VIEW 


Sees 


Updates 


CONTROLLER 


Uses 
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USER 


WEB SERVER 


PYTHON 
INTERPRETER 


DATABASE 


Bf python manage.py runserver 


This will start up a server listening to port 8000 on your 
local machine. Because this built in server is designed to 
be used for development, it automatically reloads your 
Python code for each request. This means that you don’t 
need to restart the server to see your code changes. 

All of these steps get you to a working project. You are 
now ready to start developing your applications. Within the 
“newsite” subdirectory, you can type: 


| python manage.py startapp newapp 


This will create a new subdirectory named “newapp”, with 
the files “models.py”, “tests.py” and “views.py”, among 
others. The simplest possible view consists of the code: 


from django.http import HttpResponse 
def index(request): 
return HttpResponse(“Hello world”) 


This isn’t enough to make it available, however. You will 
also need to create a URLconf for the view. If the file 
“urls.py” doesn’t exist yet, create it and then add the code: 


from django.conf.urls import url 
from . Import views 
urlpatterns = [ url(r’*$’, views.index, 
name=‘index’), J] 


The last step is to get the URL registered within your 
project. You can do this with the code 


from django.conf.urls import include, url 
from django.contrib import admin 
urlpatterns = [  url(r’*newapp/’, 
urls’)), 


include(‘newapp. 


Left Python interpreters work 
with your databases to powera 
web server 


Bottom The Model-View- 
Controller architecture is often 
used for Uls 


Virtual 
environments 


EEE 


When you start developing 
your own applications, you 
may begin adescent into 
dependency hell. Several 
Python packages depend 

on other Python packages. 
This is its strength, but also 
its weakness. Luckily, you 
have virtualenv available 

to help tame this jungle. 

You can create new virtual 
environments for each of your 
projects. Thankfully with this, 
you can be sure to capture all 
of the dependencies for your 
own package. 
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Bee: Beit ‘View " Navigate Cade _Batactor’ Rigy Toots VCS “Window | Halp 


THE EDITOR PANE 

The main editor pane can be configured to match your 
own style, or the style of one of the other main editors, 
like emacs. It handles syntax highlighting, and even 
folicyoltc\Ven-1a coal Coler-talel atc} 


Ge OF) Gres « 
import scipy 


| POR e Renee eee eee nena eee eeneeeaeeee 


result « scipy.sin(45.0) 


THE PROJECT PANE 

This pane is the central location for your project. All of 
your files and libraries are located here. Right-clicking 
inthe pane brings up a drop-down menu where you can 
add new files or libraries, run unit tests, or even start up 
adebugger 
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THE STATUS BARE 

PyCharm does a lot of work behind the scenes. 
The status bar helps you keep track of all of these 
background processes 


Tool Windows Quick Access 


| Mover over the icon below to access tool windows 
| Click the icon to make tool windows buttons visible 


ass 


Terminal 
development 
environments 


Es 


When you are in the middle of 
developing your application, 
you may need to have several 
different terminal windows 
open in order to have a code 
editor open, a monitor on the 
server, and potentially testing 
output. If you are doing this on 
your own machine, this isn’t an 
issue. But, if you are working 
remotely, you should look into 
using tmux. It can provide a 
much more robust terminal 
environment for you. 


00 entry created: You may Now eat PvCharm and start @ from the svitem manu 1! (restart @ session # & new entry 


url(r’*admin’, admin.site.urls), ] 


This needs to be put in the “urls.py” file for the main 
project. You can now pull up your newly created 
application with the URL http://localhost:8000/newapp/. 

The last part of many applications is the database 
side. The actual connection details to the database, like 
the username and password, are contained in the file 
“settings.py”. This connection information is used for 
all of the applications that exist within the same project. 
You can create the core database tables for your site with 
this command: 


I python manage.py migrate 


For your own applications, you can define the data model 
you need within the file “models.py”. Once the data 
model is created, you can add your application to the 
INSTALLED_APPS section of the “settings.py” so that 
django knows to include it in any database activity. You 
initialize it with: 


| python manage.py makemigrations newapp 


Once these migrations have been created, you need to 
apply them to the database by using the command: 


I python manage.py migrate 


Any time you make changes to your model, you will need to 
runthe makemigrations and migrate steps again. 

Once you have your application finished, you can make 
the move to the final hosting server. Don't forget to check 
the available code within the Django framework before 
putting too much work into developing your own code. 


seem not to. (2 minutes 800) “2 orocentes nummine 


225 of US 


Other Python 
frameworks 


While Django is one of the most popular frameworks around 
for doing web development, it is by no means the only one 
around. There are several others available that may prove to 
be a better fit for particular problem domains. For example, 
ifyou are looking for a really self-contained framework, you 
could look at web2py. Everything you need to be able to have 
acomplete system, from databases to web servers toa 
ticketing system, are included as part of the framework. It is 
so self-contained that it can even run from a USB drive 

Ifyou need even less of a framework, there are several 
mini-frameworks that are available. For example, CherryPy 
is a purely Pythonic multi-threaded web server that you 
foreTaN=Jan)ol-(eM/\Tidalianyelelme\iyan=le) ell (ered (olanmll allcaist-(euu0 Te lA 
the server included with TurboGears and web2py. A really 
popular microframework is a project called flask. It includes 
integrated unit testing support, jinja2 templating and RESTful 
request dispatching. 

One of the oldest frameworks around is zope, now up to 
version 3. This latest version was renamed BlueBream. Zope 
is fairly low-level, however. You may be more interested in 
looking at some of the other frameworks that are built on 
top of what is provided by zope. For example, pyramid isa 
very fast, easy to use framework that focuses on the most 
essential functions required by most web applications. To 
this end, it provides templating, the serving of static content, 
mapping of URLs to code, among other functions. It handles 
this while providing tools for application security. 

Ifyou are looking for some ideas, there are several open 
source projects that have been built using these frameworks, 
from blogs, to forums to ticketing systems. These projects can 
provide some best-practices when you go to construct your 
own application. 
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Computational science 


Python is fast becoming the go-to language for 
computational science 


Python has become one of the key languages used in 
science. There is a huge number of packages available 
to handle almost any task that you may have and, 
importantly, Python knows what it isn’t good at. To deal 
with this, Python has been designed to easily incorporate 
code from C or FORTRAN. This way, you can offload any 
heavy computations to more efficient code. 

The core package of most of the scientific code 
available is numpy. One of the problems in Python is that 
the object oriented nature of the language is the source 
of its inefficiencies. With no strict types, Python always 
needs to check parameters on every operation. Numpy 
provides a new datatype, the array, which helps solve 
some of these issues. Arrays can only hold one type of 
object, and because Python knows this it can use some 
optimisations to speed things up to almost what you can 
get from writing your code directly in C or FORTRAN. The 
classic example of the difference is the for loop. Lets say 
you wanted to scale a vector by some value, something like 


Left The numpy package 
makes it simple to visualise 
your data 


Parallel 
Python 


Le 


One of the really powerful 
parts of Ipython (or jupyter) 

is that it is built with aclient/ 
server model. This means that 
itis relatively easy to setup 
multiple machines to act as 


$oo+-t8 


So, not only is it faster, it is also written in a shorter, clearer 
form. Along with the new datatype, numpy provides 
overloaded forms of all of the operators that are of 
most use, like multiplication or division. It also provides 


a*b. In regular Python, this would look like 
for elem in b: 
c.append(a *« elem) 


In numpy, this would look like: 


axb 


optimised versions of several functions, like the trig 
functions, to take advantage of this new datatype. 

The largest package available, that is built on top of 
numpy, is scipy. Scipy provides sub-sections in several 
areas of science. Each of these sub-sections need 
to be imported individually after importing the main 
scipy package. For example, if you are doing work with 
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THE EDITOR PANE 

This pane is where you can open and edit your source 
files. Above this pane are buttons to allow you to simply 
run the code, or run it under a debugger. Under the 
debugger, you can set breakpoints and step through 
each line of code individually 


IPYTHON CONSOLE 

The console window lets you interact directly with the 
underlying interpreter that will be used when you try and 
run your code 
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aserver pool. You can then 
farm out multiple tasks to 
these other machines to get 
even more work done. While 
this doesn’t run any particular 
function in parallel, it does let 
you run longer functions in the 
background while you work on 
something else. 


VARIABLE EXPLORER 

The variable explorer pane lets you access all of the 
data structures within the current Python interpreter. 
You need to actually run your code for anything to show 


up here 


Object imspector Varwbie explorer File explorer 
Python comote 
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The need for 
speed 


——EEEs 


Sometimes you need as much 
speed as your are capable of 
pushing on your hardware. In 
these cases, you always have 
the option of using Cython. 
This lets you take C code from 
some other project, which 
has probably already been 
optimised, and use it within 
your own Python program. In 
scientific programming, you 
are likely to have access to 
code that has been worked 
on for decades and is highly 
specialised. There is no need 
to redo the development 
effort that has gone into it. 


Above The ability to generate 
complex plots is essential 


differential equations, you can use the “integrate” section 
to solve them with code that looks like 


import scipy 

import scipy.integrate 

result = scipy.integrate.quad(lambcda x: 
4.5) 


sin®, 2, 


Differential equations crop up in almost every scientific 
field. You can do statistical analysis with the “stats” 
section. If you want to do some signal processing, you can 
use the “signal” section and the “fftpack” section. This 
package is definitely the first stop for anyone wanting to do 
any scientific processing. 

Once you have collected your data, you usually need 
to graph it, in order to get a visual impression of patterns 
within it. The primary package you can use for this is 
matplotlib. If you have ever used the graphics package 
in R before, the core design of matplotlib has borrowed 
quite a few ideas. There are two categories of functions for 
graphing, low-level and high-level. High-level functions try 
to take care of as many of the menial tasks, like creating a 
plot window, drawing axes, selecting a coordinate system, 
as possible. The low-level functions give you control over 
almost every part of a plot, from drawing individual pixels 
to controlling every aspect of the plot window. It also 
borrowed the idea of drawing graphs into a memory based 
window. This means that it can draw graphs while running 
on acluster. 

If you need to do symbolic math, you may be more used 
to using something like Mathematica or Maple. Luckily, 
you have sympy that can be used to do many of the same 
things. You can use Python to do symbolic calculus, or to 
solve algebraic equations. The one weird part of sympy is 
that you need to use the “symbols()” function to tell sympy 


Interactive science 
with jupyter 


For alot of scientific problems, you need to play with your 
data in an interactive way. The original way you would do 
this was to use the lpython web notebook. This project has 
since been renamed Jupyter. For those who have used a 
program like Mathematica or Maple, the interface should 
seem very familiar. Jupyter starts a server process, by 
default on port 8888, and then will open a web browser 
where you can open a worksheet. Like most other programs 
of this type, the entries run in chronological order, notin 
iua{oxo)ce(lmuareludale\’aarele)el-1anelanua\oa(e]a <sjaloioiem lal isxerla) 
be a bit confusing at first, but it means that if you go to 
edit an earlier entry, all of the following entries need to be 
re-executed manually in order to propagate that change 
through the rest of the computations. 

Jupyter has support for pretty printing math within 
the produced web page. You can also mix documentation 
blocks and code blocks within the same page. This means 
that you can use it to produce very powerful educational 
material, where students can read about some technique, 
and then actually run it and see it in action. By default, 
Jupyter will also embed matplotlib plots within the same 
worksheet as a results section, so you can see a graph of 
some data along with the code that generated it. This is 
huge in the growing need for reproducible science. You can 
always go back and see how any analysis was done and be 
able to reproduce any result at all. 
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Above Jupyter Notebook is a web application that is used 
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what variables are valid to be considered in your equations. 
You can then start doing manipulations using these 
registered variables. 

You may have large amounts of data that you need 
to work with and analyze. If so, you can use the pandas 
package to help deal with that. Pandas has support 
for several different file formats, like CSV files, Excel 
spreadsheets or HDF5. You can merge and join datasets, 
or do slicing or subsetting. In order to get the best 
performance out of the code, the heaviest lifting is done by 
Cython code that incorporates functions written in C. Quite 
a few ideas on how to manipulate your data was borrowed 
from how things are done in R. 

You now have no reason not to start using Python for 
your scientific work. You should be able to use it for almost 
any problem that comes up! 
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Robotics and electronics 


Robotics is the most direct interface between your code and 
the real world around you 


Robotics is the most direct way that your code can 
interact with the world around you. It can read actual 
sensor information and move real actuators and get real 
work done. 

The first thing your robot needs is the ability to sense 
the world around it. The one sense that we as humans feel 
is most useful is sight. With web cameras being so cheap 
and easy to connect to hardware, vision is easy to give to 
your robot. The real problem is how to interpret this data. 
Luckily, you can use the OpenCV project to do just that. It is 
a vision package that can provide simple image gathering 
and processing, to extremely complex functions like face 
recognition and extraction of 3D objects. You can identify 
and track objects moving through your field of view. You 
can also use OpenCV to give you robot some reasoning 
capabilities, too. OpenCV includes a set of functions 


for machine learning, where you can do statistical 
classification or data clustering, and use it to feed decision 

trees or even neural networks. 
Another important sense that you may want to use is 
sound. The jasper project is one that is developing a 
" complete voice control system. This project would 
"he give you the structure you need to give your robot 
* the ability to listen for and respond to your verbal 
commands. The project has gotten to the point where 
you can give it a command and the voice recognition 
software can translate this into text. You then need to 
build a mapping of what pieces of text correspond to what 

commands to execute. 


Arduino 
——— 


In contrast to the Raspberry 
Pi, which runs a full OS from 
its SD card, the Arduino 
boards are microcontrollers 
rather than complete 
computers. Instead of 
running an OS, the Arduino 
platform executes code that 
is interpreted by its firmware. 
Itis mainly used to interface 
with hardware such as motors 
and servos, sensors, and 


Raspberry Pi 
be 


While we haven’t discussed 
what kind of computer to use 
for your robotics project, you 
should consider the famous 
Raspberry Pi. This tiny 
computer should be small 
enough to fit into almost 

any robot structure that you 
might be building. Since itis 
already running Linux and 
Python, you should be able 
to simply copy your code 
development work to the Pi. 
Italso includes its own IO bus 
so that you can have it read 
it’s own sensors. 
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There are lots of other sensors you could have, but this 
begins to leave the realm of store-bought hardware. Most 
other sensors, like temperature, pressure, orientation 
or location, need specialised hardware that needs to 
be interfaced to the computer brain for your robot. This 


devices such as LEDs, and 
is incredibly capable in this 
regard. Arduinos are widely 
used in robotics projects 
and can bea powerful 
complement to the Pi. 


ROS — Robot Operating System 


While you could simply write some code that runs on a 


is usually not optimal when trying to handle all of the data 
processing that a robot needs when dealing with events in 
realtime. When you reach this point, you may need to look at 
a dedicated operating system — the Robot Operating System 
(ROS). ROS is designed to provide the same type of interface 
between running code the computer hardware it is running 
on, with the lowest possible overhead. One of the really 
powerful features of ROS is that it is designed to facilitate 
communication between different processes running on the 
computer, or potentially over multiple computers connected 
over some type of network. Instead of each process being a 
silo that is protected from all other processes, ROS is more of 
a graph of processes with messages being passed between 
themall. 


Because ROS is a complete operating system, rather than 


that can be used in ROS. The fundamental design is to be as 
agnostic as possible. This means that interfaces to your code 
should be clean and not particularly care where they running 
or who is talking to them. Then, it can be used within the graph 
of processes running within ROS. There are standard libraries 
available that allow you to do coordinate transformations, 
useful for figuring out where sensors or limbs are in space. 
There is a library available for creating preemptible tasks for 
data processing, and another for creating and managing the 
types of messages that can be handed around the various 
processes. For extremely time-sensitive tasks, there is a 
plugin library that allows you to write a C++ plugin that can be 
loaded within ROS packages. 


For low-level work, check out Arduinos 


AnaloginOutSerial | Arduino 2:1.0.5+dfsg2-4 


AnaloginOutSerial 


4nalog input, analog output, serial output” 
alog input pin 
esult to 


so prints the results to the serial monitor 


The circuit 

* potentiometer connected to analog pin 
Center pin of the potentiometer goes 
side pins of the potentiometer go to +5¥ 

* LED connected from digital pin 9 to grou 


created 29 Dec, 2008 
modified 9 Apr 2012 
by Tom Igoe 


in the public domain 


These constants won't change They'r 

/ to the pins used 
const int analogInPin = AO; 
const int analogOutPin = 9; 


/ Analog output pin t 


means it is time to get your soldering iron out. As for 
reading the data in, this is most often done over a basic 
serial connection. You can then use the pySerial module to 
connect to the serial port and read data off the connection. 
You can use: 


import serial 


to load the module and start communicating with your 
sensor. The problem is that this is a very low-level way to 
communicate. You, as the programmer, are responsible for 
all of the details. This includes communication speed, byte 
size, flow control; basically everything. So this will definitely 
be an area of your code where you should plan on spending 
some debugging time. 

Now that you have all of this data coming in, what will 
you do with it? You need to be able to move actuators out 
in the world and have real effects. This could be motors 
for wheels or tracks, levers to shift objects, or potentially 
complete limbs, like arms or legs. While you could try and 
drive these types of electronic devices directly from the 
output ports of your computer, there usually isn’t enough 
current available to provide the necessary power. So, 
you will need to have some off-board brains capable of 
handling the supplying of power to these devices. One of 
the most popular candidates for this task is the Arduino. 


maps the result to a range 
the pulsewidth modulatior 


Analog input pin tha 


THE MAIN EDITOR 

You have access to alarge number of libraries, 

and support for a large number of versions of the 
Arduino boards. The code is essentially C, so Python 
programmers shouldn’t be too far out of their depths 


from 0 to 


(PWM) of an o 


to the analog pin 


d ground 


CONT ON AN TINIBION A) 

This pane contains output from various tasks. This 
might be compiling the source code, or uploading it to 
the Arduino board being used in your project 


attached t 


THE STATUS BAR 


The status bar reminds you which type of board your 
are currently programming for, as well as which port the 
Arduino IDE thinks it is on. Always verify this information 
before trying to upload your control program to the 


boardin question 


Luckily, the Arduino is designed to connect to the serial 
port of your computer, so you can simply use pySerial to 
talk to it. You can send commands to code that you have 
written and uploaded to the Arduino to handle the actual 
manipulations of the various actuators. The Arduino 
can talk back, however. This means that you can read 
feedback data to see what effect your movements have 
had. Did you end up turning your wheels as far as you 
wanted to? This means that you could also use the Arduino 
as an interface between your sensors and the computer, 
thus simplifying your Python code even more. There are 
loads of add-on modules available, too, that might be able 
to provide the sensing capabilities that you require straight 
out of the box. There are also several models of Arduino, so 
you may be able to find a specialised model that best fits 
your needs. 

Now that you have all of this data coming in and the 
ability to act out in the real world, the last step is giving 
your robot some brains. This is where the state of the art 
unfortunately does not live up to the fantasy of R2-D2 or 
C-3P0. Most of your actual innovative coding work will 
likely take place in this section of the robot. The general 
term for this is artificial intelligence. There are several 
projects currently underway that you could use as a 
starting point to giving your robot some real reasoning 
capability, like SimpleAl or PyBrain. 


Bypassin 
thea 


a. se 


For robotics work, you may 
need to run some code truly 
in parallel, on multiple CPUs. 
Python currently has the GIL, 
which means that thereis a 
fundamental bottleneck built 
into the interpreter. One way 
around this is to actually run 
multiple Python interpreters, 
one for each thread of 
execution. The other option 

is to move from Cpython to 
either Jython or IronPython, as 
neither has aGIL. 
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Current media 
selection 


List of 
installed 
plug-ins 


Configure 
launcher 


Make extensions for 


LUD Reddit Viewer 


XBMC with Python 


Python is the world’s most popular easy-to-use open source 
language. Learn how to use it to build your own features for 
XBMC, the world’s favourite FOSS media centre 


Resources 


XBMC: www.xbmc.org/download 
Python 2.7x 

Python IDE (optional) 
Code on FileSilo 


XBMC is perhaps the most important thing that 
has ever happened in the open source media 
centre space. It started its life on the original 
Xbox videogames console and since then it has 
become the de facto software for multimedia 
aficionados. It also has been forked into many 
other successful media centre applications such 
as Boxee and Plex. XBMC has ultimately grown 
into a very powerful open source application with 
a solid community behind it. It supports almost 
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all major platforms, including different hardware 
architectures. It is available for Linux, Windows, 
Mac OSX, Android, iOS and Raspberry Pi. 

In these pages we will learn to build extensions 
for XBMC. Extensions are a way of adding 
features to XBMC without having to learn the 
core of XBMC or alter that core in any way. One 
additional advantage is that XBMC uses Python 
as its scripting language, and this can be also 
used to build the extensions. This really helps 
new developers get involved in the project since 
Python is easy to learn compared to languages 
like C/C++ (from which the core of XBMC is made). 

XBMC supports various types of extensions (or 
Add-ons): Plugins, Programs and Skins. Plugins 
add features to XBMC. Depending on the type 
of feature, a plug-in will appear in the relevant 
media section of XBMC. For example, a YouTube 
plug-in would appear in the Videos section. 
Scripts/Programs are like mini-applications for 
XBMC. They appear in the Programs section. 
Skins are important since XBMC is a completely 
customisable application — you can change 


Rating (only available for 
hosted plug-ins) 


Localised 
description string 


Opens changelog 
for the plug-in 


the look and feel of just about every facet of 
the package. 

Depending upon which category your 
extension fits, you will have to create the 
extension directory accordingly. For example... 

Plug-ins: 

plugin.audio.ludaudi: An audio plug-in 
plugin.video.ludvidi: A video plug-in 
ScCript.xxx.xxx: A program 

In this tutorial we will build an XBMC plug-in 
called LUD Entertainer. This plug-in will provide a 
nice way to watch videos from Reddit from within 
XBMC. Our plug-in will show various content such 
as trailers and documentaries from Reddit. We'll 
also allow our users to add their own Subreddit. 
Each video can then be categorised as Hot, New, 
Top, Controversial etc. With this plug-in we will 
demonstrate how easy it is hook into XBMC’s 
built-in method to achieve a very high-quality 
user experience. 

Due to space limitations, we aren't able to print 
the full code here. We recommend downloading 
the complete code from FileSilo. 


As we have mentioned previously, each 

C extension type follows a certain directory 
naming convention. In this case we are building 
a video plug-in, so the plug-in directory name 
would be plugin.video.ludlent. But that’s just the 
root directory name — we will need several other 
olders and files as well. 
The following describes the directory structure of 
LUD Linux Entertainer: 
plugin.video.ludent — Root Plugin directory 
--addon.xml 
-- changelog.txt 
-- default.py 
-- icon.png 
-- LICENSE.txt 
-- README 
*-- resources 

|-- lib 

*-- settings.xml 


O 1 Preparing the directory structure 
XB 


@) Creating addon.xml 

An addon.xml file needs to be created in 
the root of the extension directory. The addon.xml 
file contains the primary metadata from a XBMC 
extension. It contains overview, credits, version 
information and dependencies information about 
the extension. 


The root element of addon.xml is the <addon> 
element. It is defined as: 


<addon id="plugin.video. 

ludent” name="LUD HSW Viewer” 
version="0.0.1” provider- 
name="LUDK”> 

rest of the content is placed here 
</addon> 


Here, id is the identifier for the plug-in, so 
it should be unique among all the XBMC 
extensions, and id is also used for the directory 
name; version tells XBMC the extension 
version number, which helps in its ability to 
deliver automatic updates - XBMC follows the 
Major.Minor.Patch versioning convention; name is 
the English title of the plug-in. 

Note: Steps 3 to 5 cover entries that need to be 
added within the addon.xml file. 


@) Adding dependency information 
Dependency inside an extension is 
managed using the <requires> element. 


<requires> 
<import addon="xbmc.python” 


version="2.1.0"/> 

<import addon="plugin. video. 
youtube” version="3.0.0"/> 

<import addon="plugin.video.vimeo” 
version="2.3.0"/> 

<import addon="plugin. video. 
dailymotion_com” version="1.0.0"/> 
</requires> 


In the above code we have added a dependency 
to a library called xbmc.python version 
2.1. Currently it is added as a mandatory 
dependency. To make the dependency 
optional you will need to add optional="true"; 
eg <import addon="kunal.special” 
version="0.1.0" optional="true” /> 

In the above example we have added core 
dependency xbmc.python to 2.1.0 because it’s 
the version shipped with XBMC version Frodo 
12.0 and 12.1 . If you were to add xbmc.python 
to 2.0 then it would only work in XBMC Eden 11.0 
and notin the latest version. 

For the current version of XBMC 12.1, the 
following versions of core XBMC components 
are shipped: 
xbme.python 2.1.0 
xbmc.gui 4.0.0 
xbmc.json 6.0.0 
xbmc.metadata 2.1.0 
xbmc.addon 12.0.0 

In addition to xbmc.python we are also adding 
some third-party plug-ins as dependencies, 
such as plugin.video.youtube. These plug-ins 
will be installed automatically when we install 
plugin.video.ludent. 


@) Setting up the provider and 
entry point 

Our extension is supposed to provide the video 

content for XBMC. In order to convey that, we 

have to set up the following element: 


<extension point="xbmc.python. 
pluginsource” library="default. 
py"> 

<provides>video</provides> 
</extension> 


Here, the library attribute sets up the plug-in 
entry point. In this example default.py will be 
executed when the user activates the plug-in. 
The <provides> elements sets up the media 
type it provides. This also gets reflected in the 
placement of the plug-in. Since ours is a video 
plug-in, it will show up in the Videos section 
of XBMC. 


0 Setting up plug-in metadata 

Metadata about the plug-in is provided in 
<extension point="xbmc.addon.metadata">. The 
following are the important elements... 


<platform>: Most of the time, XBMC extensions 
are cross-platform compatible. However, if you 
depend on the native platform library that is only 
available on certain platforms then you will need 
to set the supported platforms here. Accepted 
values for the platform are: all, linux, osx, osx32, 
osx64, ios (Apple iOS) , windx (Windows DirectX), 
wingl (Windows OpenGL) and android. 


<summary lang="en">: This gives a_ brief 
description of the plug-in. Our example sets the 
language attribute as English, but you can use 
other languages too. 

<description>: A detailed description of the 
plug-in. 

<website>: Webpage where the plug-in is hosted. 
<source>: Source code repository URL. If you are 
hosting your plug-in on GitHub, you can mention 
the repository URL here. 

<forum>: Discussion forum URL for your plug-in. 
<email>: Author email. You can directly type email 
or use a bot-friendly email address like max at 
domain dotcom. 


0 Setting changelog, icon, fanart 
and licence 

We need a few additional files in the plug-in 

directory... 


changelog.txt: You should list the changes made 
to your plug-in between releases. The changelog 
is visible from the XBMC UI. 


An example changelog: 

0.0.1 

- Initial Release 

0.0.2 

- Fixed Video Buffering Issue 


icon.png: This will represent the plug-in in the 
XBMC UI. It needs to be a non-transparent PNG 
file of size 256x256. 


fanart.jpg (optional): The fanart.jpg is rendered 
in the background if a user selects the plug-in 
in XBMC. The art needs to be rendered in HDTV 
formats, so its size can range from 1280x720 
(720p) up to the maximum 1920x1080 (1080p). 


/ 


 —— 
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License.txt: This file contains the licence of 
the distributed plug-in. The XBMC project 
recommends the use of the Creative Commons 
Attribution-ShareAlike 3.0 licence for skins, 
and GPL 2.0 for add-ons. However, most of the 
copyleft licences can be used. 


Note: For the purpose of packaging, extensions/ 
add-ons/themes/plug-ins are the same. 


07 Providing settings for the plug-in 
Settings can be provided by the file 
resources/settings.xml. These are great for user- 
configurable options. 


<settings> 

<category label="30109"> 
<setting id="filter” type="bool” 
label="30101" default="false”/> 
<setting type="sep” /> 

<setting id="showAll” type="bool” 
label="30106" default="false"/> 
<setting id="showUnwatched” 
type="bool” label="30107" 
default="true”/> 

<setting id="showUnfinished” 
type="bool” label="30108" 
default="false”/> 

<setting type="sep” /> 

<setting id="forceViewMode” 
type="bool” label="30102”" 
default="true”/> 

<setting id="viewMode” type="number” 
label="30103" default="504"/> 
</category> 

<category label="30110"> 
<setting id="cat_hot” type="bool” 
label="30002" default="true”/> 
<setting id="cat_new” type="bool” 
label="30003" default="true”/> 
</category> 

</settings> 


Here, label defines the language id string which 
will then be used to display the label. id defines 
the name which will be used for programmatic 
access. type defines the data type you want 
to collect; it also affects the UI which will be 
displayed for the element. default defines the 
default value for the setting. You should always 
use a default value wherever possible to provide a 
better user experience. 
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The following are a few important settings 
types that you can use... 
text: Used for basic string inputs. 
ipaddress: Used to collect internet addresses. 
number: Allows you enter a number. XBMC will 
also provide an on-screen numeric keyboard for 
the input. 
slider: This provides an elegant way to collect 
integer, float and percentage values. You can get 
the slider setting in the following format: 


<setting label="21223" type="slider” 
id="sideinput” default="10”" 
range="1,1,10" option="int” /> 


In the above example we are creating a slider with 
min range 1, max range 10 and step as 1. In the 
option field we are stating the data type we are 
interested in — we can also set option to "float" 
or"percent". 


bool: Provides bool selection in the form of on 
or off. 

file: Provides a way to input file paths. XBMC will 
provide a file browser to make the selection of file. 
If you are looking to make selection for a specific 
type of file you can use audio, video, image or 
executable instead of file. 


folder: Provides a way to browse for a folder... 


<setting label="12001" type="folder” 
id="folder” source="auto” 
option="writeable"/> 

Here, source sets the start location for the 
folder, while option sets the write parameter for 
the application. 


sep & lsep: sep is used to draw a horizontal line 
in the setting dialog; lsep is used for drawing 
a horizontal line with text. They do not collect 
any input but are there for building better user 
interface elements... 


<setting label="21212" type="1sep” 
/> 


0 Language support 


Language support is provided in 
the form of the strings.xml file located in 
resources/languages/[language name]. This 
approach is very similar to many large software 
projects, including Android, where static strings 
are never used. 


eee 


<?xml version="1.0" encoding="utf-8”" 
standalone="yes"?> 

<strings> 

<string id="30001">Add subreddit</ 
string> 

<string id="30002">Hot</string> 
<string id="30003">New</string> 
<string id="30004">Top</string> 
<string id="30005">Controversial</ 
string> 

<string id="30006">Hour</string> 
<string id="30007">Day</string> 
<string id="30008">Week</string> 
<string id="30009">Month</string> 
<string id="30010">Year</string> 
</strings> 


As you may have seen in the settings.xml 
example, all the labels are referring to string 
ids. You can have many other languages as 
well. Depending upon the language XBMC is 
running in, the correct language file will be 
loaded automatically. 

Post XBMC Frodo (12.1), strings.xml will be 
deprecated. Post Frodo, XBMC will be moved 
to a GNU gettext-based translation system; 
gettext uses PO files. You can use a tool called 
xbmc-xml2po to convert strings.xml into 
equivalent PO files. 


0 Building default.py 


Since our plug-in is small, it will all be 
contained inside default.py. If you are developing 
a more complex add-on then you can create 
supporting files in the same directory. If your 
library depends upon third-party libraries, you 
have two ways to go about it. You can either place 
the third-party libraries into the resources/lib 
folder; or bundle the library itself into a plug-in, 
then add that plug-in as the dependency in the 
addon.xml tile. 

Our plug-in works with reddit.tv. This is the 
website from Reddit which contains trending 
videos shared by its readers. Videos posted on 
Reddit are actually sourced from YouTube, Vimeo 
and Dailymotion. 

We will be starting off default.py using the 
following imports: 


import urllib 
import urllib2 


import xbmcplugin 


import xbmcgui 
import xbmcaddon 


Apart from  xbmcplugin, xbmecgui and 
xbmeaddon, the rest are all standard Python 
libraries which are available on PyPl (Python 
Package Index) via pip. You will not need to install 
any library yourself since the Python runtime for 
XBMC hasallthe components built in. 

urllib and urllib2 help in HTTP communication. 
socket is used for network I/O; re is used 
for regular expression matching; sqlite3 is 
the Python module for accessing an SQLite 
embedded database; xbmcplugin, xbmegui and 
xbmcaddon contain the XBMC-specific routine. 


1 Initialising 

During the initialisation process, we will 
be reading various settings from settings.xml. 
Settings can be read in the following way: 


addon = xbmcaddon.Addon() 
filterRating = int(addon. 
getSetting("filterRating”)) 
filterVoteThreshold = int(addon.getS 
etting("filterVoteThreshold”)) 


In order to read settings of type bool you will need 
todo something like: 


filter = addon.getSetting("filter”) 
== "true” 


We are also setting the main URL, plug-in handle 
and the user agent for it: 


pluginhandle = int(sys.argv[1]) 
urlMain = "http://www.reddit.com” 
userAgent = "Mozilla/5.@ (Windows NT 
6.2; WOW64; rv:22.0) Gecko/20100101 
Firefox/22.0" 

opener = urllib2.build_opener() 
opener.addheaders = [( ‘User-Agent’, 
userAgent) ] 


1 1 Reading localised strings 

As mentioned, XBMC uses strings.xml to 
serve up the text. In order to read those strings, 
you will need to use getLocalizedString. 


translation = addon. 
getLocalizedString 
translation(30002) 


In this example, translation(30002) — will 
return the string "Hot" when it is running in an 
English environment. 


LlaFite 
= 


plugin://plugin 
plugin://plugin 


1 Building helper functions 


In this step we will look at some of the 
important helper functions. 


pl : i 
plugin://plugin 
lugin: i 


| iaPath | 
| 3 | 2 | 


getDbPath(): This returns the location of the 
SQLite database file for videos. XBMC stores 
library and playback information in SQLite DB 
files. There are separate databases for videos 
and music, located inside the .xbmc/userdata/ 
Database folder. We are concerned with the 
videos DB. It is prefixed with ‘MyVideos’... 


def getDbPath(): 
path = xbmc. 
translatePath("special://userdata/ 
Database”) 
files = os.listdir(path) 
latest = "" 
for file in files: 
if filel:8] == ‘MyVideos’ 
and file[-3:] == ‘.db’: 
if file > latest: 
latest = file 
return os.path. join(path, 
latest) 


getPlayCount(url): Once we have the database 
location, we can get the play count using a 
simple SQL query. The MyVideo database 
contains a table called files, which keeps a 
record of all the video files played in XBMC by 
filename. In this case it will be URL. 


dbPath = getDbPath() 
conn = sqlite3.connect(dbPath) 
c = conn.cursor() 


def getPlayCount (url): 
c.execute(‘SELECT playCount FROM 
files WHERE strFilename=?’, [url]) 
result = c.fetchone() 
if result: 
result = resultlQ] 
if result: 
return int(result) 
return @ 
return -1 


J 
<a 
T7_ 


ee 
ee 
Fore-06-o80009 | SS 
ee 
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The above table is an example of a files table. 


addSubreddit(): Our plug-in allows users to add 
their own Subreddit. This function takes the 
Subreddit input from the user, then saves it in 
the subreddits file inside the addon data folder. 


The following sets the subreddits file location: 
subredditsFile = xbmc. 
translatePath("special://profile/ 
addon_data/”+addonID+"/subreddits”) 
this translates into .xbmc/userdata/ 
addon_data/plugin. video. ludent/ 
subreddits 


def addSubreddit(): 
keyboard = xbmc.Keyboard(‘’, 
translation(30001)) 
keyboard. doModal () 
if keyboard.isConfirmed() and 
keyboard. getText(): 
subreddit = keyboard. 
getText() 
fh = open(subredditsFile, 
Sas) 
fh.write(subreddit+’\n’) 
fh.close() 


This function also demonstrates how to take 
a text input from the user. Here we are calling 
the Keyboard function with a text title. Once it 
detects the keyboard, it writes the input in the 
subreddits file with a newline character. 


getYoutubeUrl(id): When we locate a YouTube 
URL to play, we pass it on to the YouTube plug-in 
(plugin.video.youtube) to handle the playback. To 
do so, we need to call it in acertain format... 


def getYoutubeUr1 (id): 

url = "plugin: //plugin. 
video. youtube/?path=/root/ 
video&action=play_video&videoid=" + 
id 

return url 


/ 


 —— 
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Similarly for Vimeo: 


def getVimeoUr1 (id): 

url = "plugin://plugin.video. 
vimeo/?path=/root/video&action=play_ 
video&videoid=" + id 

return url 


And for Dailymotion: 


def getDailyMotionUrl (id): 

url = "plugin: //plugin. video. 
dailymotion_com/?url=" + id + 
"&mode=playVideo” 

return url 


Once we have the video URL resolved into the 
respective plug-in, playing it is very simple: 


def playVideo(url): 

listitem = xbmcgui. 
ListItem(path=ur1) 

xbmcplugin. 
setResolvedUrl(pluginhandle, True, 
listitem) 


1 Populating plug-in content listing 
xbmeplugin contains various routines 
for handling the content listing inside the 
plug-ins UI. The first step is to create directory 
entries which can be selected from the XBMC 
Ul. For this we will use a function called 
xbmeplugin.addDirectoryltem. 

For our convenience we will be abstracting 
addDirectoryltem to suit it to our purpose, so 
that we can set name, URL, mode, icon image 
and type easily. 


def addDir(name, url, mode, 
iconimage, type=""): 

u = sys.argv[Q@]+"?url="+turllib. 
quote_plus(url)+"&mode="+str(mode)+” 
&type="+str (type) 

ok = True 

liz = xbmcgui.ListItem(name, 
iconImage="DefaultFolder.png”, 
thumbnailImage=iconimage) 

liz.setInfo(type="Video” , 
infoLabels={"Title”: name}) 

ok = xbmcplugin. 
addDirectoryItem(handle=int(sys. 
argv[1]), url=u, listitem=liz, 
isFolder=True) 

return ok 
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On the same lines, we can build a function to 
place links as well... 


def addLink(name, url, mode, 
iconimage, description, date): 

u = sys.argv[Q@]+”?url="turllib. 
quote_plus(url)+"&mode="+str (mode) 

ok = True 

liz = xbmcgui.ListItem(name, 
iconImage="DefaultVideo. png”, 
thumbnailImage=iconimage) 

liz.setInfo(type="Video", 
infoLabels={"Title”: name, "Plot”: 
description, "Aired”: date}) 

liz.setProperty(‘IsPlayable’ , 
‘true’ ) 

ok = xbmcplugin. 
addDirectoryItem(handle=int(sys. 
argv[1]), url=u, listitem=liz) 

return ok 


Based on the abstractions we have just created, 
we can create the base functions which will 
populate the content. But before we do that, 
let’s first understand how Reddit works. Most of 
the Reddit content filters are provided through 
something called Subreddits. This allows you to 
view discussions related to a particular topic. In 
our plug-in we are interested in showing videos; 
we also want to show trailers, documentaries 
etc. We access these using Subreddits. For 
example, for trailers it would be reddit.com/r/ 
trailers. For domains we can use /domain; for 
example, to get all the YouTube videos posted 
on Reddit, we will call reddit.com/domain/ 
youtube.com. Now you may ask what is the 
guarantee that this Subreddit will only list 
videos? The answer is that it may not. For that 
reason we scrape the site ourselves to find 
videos. More on this in the next step. 

The first base function we'll define is index(). 
This is called when the user starts the plug-in. 


def index(): 

defaultEntries = ["videos”, 
"trailers", "documentaries", 
"music" ] 

entries = defaultEntries[: ] 

if os.path. 
exists(subredditsFile): 

fh = open(subredditsFile, 


Sti) 
content = fh.read() 
fh.close() 
spl = content.split(‘\n’) 
for i in range(@, len(spl), 
aye 


if spl{lil: 
subreddit = spl[il] 
entries. 
append(subreddit) 
entries.sort() 
for entry in entries: 
if entry in defaultEntries: 
addDir(entry.title(), 
"r/"+entry, ‘listSorting’, "”) 
else: 
addDirR(entry.title(), 
"r/"+entry, ‘listSorting’, "”) 
addDir("[ Vimeo.com ]", 
"domain/vimeo.com”, ‘listSorting’, 
ee) 
addDir("[ Youtu.be ]”, "domain/ 
youtu.be”, ‘listSorting’, "") 
addDir("[ Youtube.com 
J", "domain/youtube.com”, 
‘listSorting’, "”) 
addDir("[ Dailymotion.com 
J", "domain/dailymotion.com”, 
‘listSorting’, "”) 
addDir("[B]- 
"+translation(30001)+” -[/B]”, "”, 
‘addSubreddit’, "”) 
xbmcplugin. 
endOfDirectory(pluginhandle) 


Here, the penultimate entry makes a call to 
addSubreddit. listSorting takes care of sorting 
out the data based on criteria such as Hot, 
New etc. It also calls in Reddit’s JSON function, 
which returns nice easy-to-parse JSON data. 

We have created a settings entry for all the 
sorting criteria. Based on what is set, we go 
ahead and build out the sorted list. 


def listSorting(subreddit): 
iiieeCacanoice 
addDir(translation(300Q@2) , 
urlMaint+”"/"+subreddit+”/hot/. 
json?limit=100", ‘listVideos’, "”) 
if cat_new: 
addDir(translation(30003) , 
urlMaint”/"+subredditt+”/new/. 
json?limit=100", ‘listVideos’, "") 
if cat_top_d: 


addDir(translation(30004)+”: 
"+translation(300Q7) , 
urlMaint+”/"+subreddit+”/ 
top/. json?limit=100&t=day”, 
‘listVideos’, "") 
xbmcplugin. 
endOfDirectory(pluginhandle) 


/ 


In the code listed to the left here, we are 


def listVideos(url): opening the URL, then — based on regular 
currentUrl = url expression matches — we are discovering 
xbmcplugin.setContent(pluginhandle, "episodes”) the location title, description, date, ups, 
content = opener.open(url).read() downs and rating. We are also locating 
spl = content.split(‘”content”’) video thumbnails and then passing them on 
for i in range(1, len(spl), 1: to XBMC. 
entry = spl{il Later in the code, we also try to match the 
try: URL to a video provider. With our plug-in we are 
match = re.compile(‘"title": "(.+4?)'", re.DOTALL).findall(entry) supporting YouTube, Vimeo and Dailymotion. 
title = match[Q].replace(&amp;”, "&”) f this is detected successfully, we call the 
match = re.compile(‘"description”: "(.+?)'”, re.DOTALL). helper functions to locate the XBMC plug- 
findall(entry) in based playback URL. During this whole 
description = match[2] parsing process, if any exception is raised, the 
match = re.compile(‘"created_utc”: (.+?),’, re.DOTALL).findall(entry) whole loop is ignored and the next JSON item 
downs = int(match{Q}.replace(}’, "")) Ss parsed. 
rating = int(ups*100/(ups+downs)) ; ; 
if filter and (upstdowns) > filterVoteThreshold and rating < 15 Installing & running the add-on 
filterRating: You can install the add-on using one of 
continue the following two methods: 
title = title+” ("+str(rating)+’"%)” + You can copy the plug-in directory to 
match = re.compile(‘"num_comments”: (.+?),’, re.DOTALL). -xbmc/addons. 
findall(entry) - You can install the plug-in from the zip file. To 
comments = match[@] do so, compress the add-on folder into a zip file 
description = dateTimet’ | "+str(upstdowns)+” votes: using the command: 
"+str(rating)+"% Up | "+comments+” comments\n"+description $ ee -r plugin.video. ludent.zip 
match = re.compile(‘”thumbnail_url": "(+7)", re.DOTALL). plugin. video. ludent 
findall@entry) To install the plug-in from the zip file, open 
thumb = match[Q] XBMC, go to System then Add-ons, then click 
matchYoutube = re.compile(‘"url”: "http://www.youtube.com/ ‘Install from zip file. The benefit of installing 
watch\\?v=(.4?)"”, re.DOTALL).findall(entry) from a zip file is that XBMC will automatically 
matchVimeo = re.compile(‘"url”: "http://vimeo.com/(.4?)'"”, try to install all the dependent plug-ins as well. 
re.DOTALL).findall(entry) 
url =" Once you have the plug-in installed, you can 
if matchYoutube: run it by going to the Videos Add-ons section of 
url = getYoutubeUrl(matchYoutube[2]) XBMC, selecting Get More... and then clicking 
elif matchVimeo: on LUD Reddit Viewer. 
url = getVimeoUrl(matchVimeo[@].replace("#”, ””)) You can access the settings dialog of the 
if url: plug-in by right-clicking the LUD Reddit Viewer, 
addLink(title, url, ‘playVideo’, thumb, description, date) then selecting Add-on settings’. 
except: 
pass So, you have seen how robust and powerful 
match = re.compile(‘"after”: "(.+?)’”, re.DOTALL).findall(entry) XBMC's extension system is. In this example, 
xbmcplugin.endOfDirectory(pluginhandle) we were able to leverage the full power of 
if forceViewMode: Python (including those magical regular 
xbme.executebuiltin(‘Container.SetViewMode(‘+viewMode+’)’) expression matches) from within XBMC. 
XBMC itself also offers a robust UI framework, 
which provides a very professional look for 
14 Populating the episode view (listing videos) our add-on. 
At this point we have the URL in hand, which returns JSON data; now we need to extract the As powerful as it may seem, we have only 
data out of it which will make sense to us. built a video plug-in. XBMC’s extension system 


By looking at the JSON data, you can see there’s a lot of interesting information present here. For also provides a framework for building fully 
example, url is set to youtube.com/watch?v=n4rIztwx8E; title is set to ‘The Counselor — Official fledged programs (called Programs). We will 
Trailer’. There also many other bits of data that we will use, such as ups, downs, num_comments, cover this ina later issue. 
thumbnail_url and so on. In order to filter out the data that we need, we will use regular expressions. 

There is one more thing to note: since we are not presenting directories any more but are ready to a 
place content, we have to set the xbmcplugin.setContent to episodes mode. 
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Asimple Python 
program for 
Polynomial Fitting! 


A Python script 
that uses SciPy to 
process an image 


Matplotlib 
generated output 


be passec-th 


Finding help 
is easy 


Scientific computing 


with NumPy 


Resources 
NumPy: 


www.numpy.org 


SciPy: 


www.scipy.org 


Matplotlib: 


www.matplotlib.org 
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NumPy is the primary Python package for 
performing scientific computing. It has a 
powerful N-dimensional array object, tools 
for integrating C/C++ and Fortran code, linear 
algebra, Fourier transform, and random 
number capabilities, among other things. 
NumPy also supports broadcasting, which is 
a clever way for universal functions to deal in 
a meaningful way with inputs that do not have 
exactly the same form. 

Apart from its capabilities, the other 
advantage of NumPy is that it can be integrated 
into Python programs. In other words, you may 
get your data from a database, the output of 
another program, an external file or an HTML 
page and then process it using NumPy. 

This article will show you how to install 
NumPy, make calculations, plot data, read and 
write external files, and it will introduce you to 
some Matplotlib and SciPy packages that work 
well with NumPy. 


Powerful calculations with 
NumPy, SciPy and Matplotlib 


NumPy also works with Pygame, a Python 
package for creating games, though explaining 
its use is beyond of the scope of this article. 

It is considered good practice to try the 
various NumPy commands inside the Python 
shell before putting them into Python programs. 

The examples in this article are using either 
Python shell or iPython. 


0 1 Installing NumPy 


Most Linux distributions have a 
ready-to-install package you can use. After 
installation, you can find out the NumPy version 
you are using by executing the following: 


$ python 

Python 2.7.3 @efault, Mar 13 2014, 11:03:55) 
[GCC 4.7.2] on linux2 

Type “help”, "copyright", “credits” or 
“license” for more information. 

>>> numpy.version.version 


Traceback (most recent call last): 

File "<stdin>", line 1, in <module> 
NameError: name 'numpy’ is not defined 
>>> import numpy 
>>> numpy.version.version 
winGr24 
>> 


Not only have you found the NumPy version but 
you also know that NumPy is properly installed. 


@) About NumPy 
Despite its simplistic name, NumPy is 
a powerful Python package that is mainly for 
working with arrays and matrices. 
There are many ways to create an array but 
the simplest is by using the array() function: 


>>> oneD = array([1,2,3,4]) 


The aforementioned command creates a 
one-dimensional array. If you want to create a 
two-dimensional array, you can use the array() 
function as follows: 


>>> twoD = array([ [1,2,3], 
eeercis 
(-1,-0.5,4], 
[0,1,0]] ) 


You can also create arrays with more dimensions. 


@) Making simple calculations 
using NumPy 

Given an array named myArray, you can find 

the minimum and maximum values in it by 

executing the following commands: 


>>> myArray.min() 
>>> myArray.max() 


Should you wish to find the mean value of all 
array elements, run the next command: 


>>> myArray.mean() 


Similarly, you can find the median of the array 
by running the following command: 


>>> median(myArray) 


The median value of a set is an element that 
divides the data set into two subsets (left 
and right subsets) with the same number of 
elements. If the data set has an odd number of 
elements, then the median is part of the data 
set. On the other side, if the data set has an 
even number of elements, then the median is 
the mean value of the two centre elements of 
the sorted data set. 


>>> from numpy import * 

>>> myArray = array((1, 

>>> myArray.min() 

-100 

>>> myArray.max() 

200 

>>> myArray.mean() 

pl PERE REE EEE REERE 7] 

>>> myArray.median() 

Traceback (most recent 
File “<stdin>", Line 

AttributeError: ‘numpy. 

>>> myArray.median 

Traceback (most recent 
File “<stdin>", Line 

AttributeError: ‘numpy. 

>>> myArray.median() 

Traceback (most recent 
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2,3, 40, -108, 200) ) 


call last): 
1, in <module> 
ndarray’ object attribute 
call last): 
1, in <module> 
ndarray’ object attribute 


call last): 


‘median 


‘median 


s 
Making simple 
calculations 


File “<stdin>", Line 1, in <module> 
AttributeError: ‘numpy.ndarray' object h 
>>> myArray.median(myArray) 

Traceback (most recent call last): 

File “<stdin>", Line 1, in <module> 

AttributeError: ‘numpy.ndarray' object 


@) Using arrays with NumPy 

NumPy not only embraces the indexing 
methods used in typical Python for strings and 
lists but also extends them. If you want to select 
a given element from an array, you can use the 
following notation: 


>>> twoD[1,2] 


You can also select a part of an array (a slice) 
using the following notation: 


>>> twoD[:1,1:3] 


Finally, you can convert an array into a Python 
list using the tolist() function. 


0 Reading files 
Imagine that you have just extracted 
information from an Apache log file using AWK and 
you want to process the text file using NumPy. 
The following AWK code finds out the total 
number of requests per hour: 


$ cat access.log | cut -d[ -f2 | cut -d] 
-f1 | awk -F: ‘{print $2}' | sort -n | unig 
-c | awk ‘{print $2, $1}’ > timeN.txt 


The format of the text file (timeN.txt) with the 
data is the following: 


@@ 191 
@1 225 
@2 121 
Q@3 104 


Reading the timeN.txt file and assigning it toa 
new array variable can be done as follows: 


aa = np.loadtxt("timeN.txt”) 


attribute ‘median 


attribute ‘median 


9) Writing to files 

Writing variables to a file is largely 
similar to reading a file. If you have an array 
variable named aal, you can easily save its 
contents into a file called aat.txt by using the 
following command: 


In [17]: np.savetxt("aal.txt”, aal) 


As you can easily imagine, you can read 
the contents of aaltxt later by using the 
loadtxt() function. 


@) Common functions 

NumPy supports many numerical and 
statistical functions. When you apply a function 
to an array, the function is automatically applied 
to allarray elements. 

When working with matrices, you can find the 
inverse of a matrix AA by typing “AA.I”. You can 
also find its eigenvalues by typing “np.linalg. 
eigvals(AA)” and its eigenvector by typing “np. 
linalg.eig(BB)”. 


9) Working with matrices 

A special subtype of a two-dimensional 
NumPy array is a matrix. A matrix is like an 
array except that matrix multiplication replaces 
element-by-element multiplication. Matrices 
are generated using the matrix (or mat) function 
as follows: 


In [2]: AA = np.mat(’'@ 1 1; 111; 111) 
You can add two matrices named AA and BB by 


typing AA + BB. Similarly, you can multiply them 
by typing AA * BB. 


a 
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root@mail:~# apt-get install python-matplotlib Ooronentn 

Reading package lists... Done Matplotlib 

Building dependency tree 

Reading state information... Done 

The following extra packages will be installed: 
blt fonts—lyx girl.2-glib-2.0 Libgirepository-1.0-1 Libglade2-0 python-cairo 
python-dateutil python-gi python-glade2 python-gobject python-gobject-2 python-gtk2 
python-matplotlib-data python-pyparsing python-tk python-tz 

Suggested packages: 
blt-demo python-gi-cairo python-gtk2-doc python-gobject-2-dbg dvipng ipython 
python-configobj python-excelerator python-matplotlibd-doc python-qt4 python-traits 
python-wxgtk2.8 texlive-extra-utils texlive-lLatex-extra tix 

The following NEW packages will be installed: 
blt fonts—lyx girl.2-glib-2.@ Libgirepository-1.6-1 Libglade2-0 python-cairo 
python-dateutil python-gi python-glade2 python-gobject python-gobject-2 python-gtk2 
python-matplotlib python-matplotlib-data python-pyparsing python-tk python-tz 

®@ upgraded, 17 newly installed, ® to remove and @ not upgraded. 

Need to get 10.4 MB of archives. 

After this operation, 31.3 MB of additional disk space will be used. 

Do you want to continue [Y/n]? Y 

Get:1 http://ftp.us.debian.org/debian/ wheezy/main bit amd64 2.4z-4.2 [1,694 kB) 

Get:2 http://ftp.us.debian.org/debian/ wheezy/main fonts—-lyx all 2.0.3-3 [167 kB] 

Get:3 http://ftp.us.debian.org/debian/ wheezy/main Libgirepository-1.@-1 amd64 1.32.1-1 [1 


http://ftp. 
http://ftp. 
http://ftp. 
http://ftp. 


-debian.org/debian/ wheezy/main girl.2-glib-2.0 amd64 1.32.1-1 [171 kB) 
-debian.org/debian/ wheezy/main lLibglade2-0 amd64 1:2.6.4-1 [89.8 kB) 

.debian.org/debian/ wheezy/main python-cairo amd64 1.8.8-1+b2 [84.2 kB) 
-debian.org/debian/ wheezy/main python-dateutil all 1.5+¢dfsg-@.1 [55.3 


http://ftp. 
http://ftp. 


-debian.org/debian/ wheezy/main python-gi amd64 3.2.2-2 [518 kB) 
-debian.org/debian/ wheezy/main python-gobject-2 amd64 2.28.6-10 [555 k 


710 http://ftp.us.debian.org/debian/ wheezy/main python-gtk2 amd64 2.24,0-3+b1 [1,805 k 


:11 http://ftp.us.debian.org/debian/ wheezy/main python-glade2 amd64 2.24.0-3+b1 [45.8 
112 http://ftp. 
113 http://ftp. 

(2,057 kB] 

Get:14 http://ftp. 

+7 kB) 

Get:15 http://ftp. 

Get:16 http://ftp. 

,695 kB) 


-debian.org/debian/ wheezy/main python-gobject all 3.2.2-2 [162 kB) 
-debian.org/debian/ wheezy/main python-matplotlib-data all 1.1.1+rc2-1 


-debian.org/debian/ wheezy/main python-pyparsing all 1.5.6+dfsgl-2 [64 


-debian.org/debian/ wheezy/main python-tz all 2012c-1 [39.9 kB) 
-debian.org/debian/ wheezy/main python-matplotlib amd64 1.1.1~rc2-1 [2 


Get:17 http://ftp.us.debian.org/debian/ wheezy/main python-tk amd64 2.7.3-1 [50.9 kB) i} 
| | 


IAI 
wisciPy is built on top of NumPy 
and is more advanced i 


In [36]: from scipy.stats import poisson, lognorm Fig @1 

In [37]: mySh = 10; 

In [38]: myMu = 10; 

In [39]: In = lognorm(mySh) 

In [40]: p = poisson(myMu) 

In [41]: 1n.rvs((10,)) 

Out[41]: 

array([ 9.29393114e-@2,  1.15957068e+@1, 9.78411983e+01, 
8.26370734e-07,  5.64451441e-03,  4.61744055e-09, 
4.98471222e-06,  1.45947948e+02, 9.25502852e-06, 
5 .87353720e-02]) 

In [42]: p.rvs((10,)) 

Out[42]: array([12, 11, 9, 9, 9, 10, 9, 4, 13, 8]) 

In [43]: In.pdf(3) 


Out[43]: @.013218067177522842 
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09 Plotting with Matplotlib 


The first move you should make is to 
install Matplotlib. As you can see, Matplotlib has 
many dependencies that you should also install. 

The first thing you will learn is how to 
plot a polynomial function. The necessary 
commands for plotting the 3x*2-x+1 
polynomial are the following: 


import numpy as np 

import matplotlib.pyplot as plt 
myPoly = np.polyld(np.array([3, -1, 1]). 
astype(float)) 

x = np.linspace(-5, 5, 100) 

y = myPoly(x) 

plt.xlabel(’x values’) 
plt.ylabel(’f(x) values’) 

xticks = np.arange(-5, 5, 10) 
yticks = np.arange(@, 100, 10) 
plt.xticks(xticks) 
plt.yticks(yticks) 
plt.grid(True) 

plt.plot(x,y) 


The variable that holds the polynomial 
is myPoly. The range of values that will 
be plotted for x is defined using “x = 
np.linspace(-5, 5, 100)”. The other important 
variable is y, which calculates and holds the 
values of f(x) for each x value. 

It is important that you start ipython using 
the “ipython --pylab=qt” parameters in order 
to see the output on your screen. If you are 
interested in plotting polynomial functions, 
you should experiment more, as NumPy can 
also calculate the derivatives of a function and 
plot multiple functions in the same output. 


1 About SciPy 

SciPy is built on top of NumPy and 
is more advanced than NumPy. It supports 
numerical integration, optimisations, signal 
processing, image and audio processing, 
and statistics. The example in Fig. 01 (to the left) 
uses a small part of the scipy.stats package that 
is about statistics. 

The example uses two statistics distributions 
and may be difficult to understand even if you 
know mathematics, but it is presented in order 
to give you a better taste of SciPy commands. 


1 Using SciPy for image processing 
Now we will show you how to process 
and transform a PNG image using SciPy. 
The most important part of the code is the 
following line: 


image = np.array(Image.open('SA.png’). 
convert(’L’)) 


This line allows you to read a usual PNG 
file and convert it into a NumPy array for 
additional processing. The program will 
also separate the output into four parts and 
displays a different image for each of these 
four parts. 


1 Other useful functions 
lt is very useful to be able to find out 

the data type of the elements in an array; it 
can be done using the dtype() function. 

Similarly, the ndim() function returns the 
number of dimensions of an array. 

When reading data from external files, you 
can save their data columns into separate 
variables using the following way: 


In [10]: aal,aa2 = np.loadtxt("timeN.txt”, 
usecols=(@,1), unpack=True) 


The aforementioned command saves column 
1 into variable aal and column 2 into variable 
aa2. The “unpack=True” allows the data to be 
assigned to two different variables. Please 
note that the numbering of columns starts 
with 0. 


13 Fitting to polynomials 

The NumPy polyfit() function tries to fit 
a set of data points to a polynomial. The data 
was found from the timeN.txt file, created 
earlier in this article. 

The Python script uses a fifth degree 
polynomial, but if you want to use a different 
degree instead then you only have to change 
the following line: 


coefficients = np.polyfit(@al, aa2, 5) 


1 Array broadcasting in NumPy 

To close, we will talk more about 
array broadcasting because it is a very 
useful characteristic. First, you should know 
that array broadcasting has a rule: in order 
for two arrays to be considered for array 
broadcasting, “the size of the trailing axes for 
both arrays in an operation must either be the 
same size or one of them must be one.” 

Put simply, array broadcasting allows 
NumPy to “change” the dimensions of an array 
by filling it with data in order to be able to do 
calculations with another array. Nevertheless, 
you cannot stretch both dimensions of an 
array to do your job. 
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Each message 
has atime stamp 
prefixed to it 


Aclient can detect 
when the server 
exits without 
crashing or hanging 


2013-04-21 14:28:26.727603 Server has quit. 


5013-04-21 14:27:55.333252 client2 has joined 
13-04-21 14:27:59.383522 client2 says: Hi 


2013-04-21 14:28:09.799543 client says: Hi 


0013-04-21 14:28:19.703694 client1 has quit. 


The server notifies 
all clients whena 
new client joins 


Similarly, the server 
notifies all clients 
when a client leaves 


Instant messaging with Python 


How to program both the client, complete with a GUI, and 
server of asimple instant messenger in Python 


Resources 


A computer - running your favourite Linux 


distribution 


Internet connection - to access 


documentation 


Python 2.x, PyGTK and GObject - 


packages installed 
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He’re we'll be implementing an_ instant 
messenger in Python with a client-server 
architecture. This means each client connects 
to the server, which relays any message that 
one client sends to all other clients. The server 
will also notify the other clients when someone 
joins or leaves the server. The instant messenger 
can work anywhere a TCP socket can: on the 
same computer with the loopback interface, 
across various computers on a LAN, or even 
over the internet if you were to configure your 
router correctly. However, our messages aren’t 
encrypted, so we wouldn't recommend that. 

Writing an instant messenger is an interesting 
technical problem that covers a bunch of 
areas that you may not have come across while 
programming before: 

* We'll be employing sockets, which are used 
to transmit data across networks. 


* We'll also be using threading, which allows a 
program to do multiple things at once. 

¢ We'll cover the basics of writing a simple 
graphical user interface with GTK, as well as 
how to interact with that from a different thread. 

¢ Finally, we'll be touching on the use of 
regular expressions to easily analyse and extract 
data from strings. 

Before getting started, you'll need to have 
a Python2.x interpreter installed, as well as 
the PyGTK bindings and the Python2 GObject 
bindings. The chances are that if you have a 
system with a fair amount of software on it, 
you will already have these packages, so it may 
be easier to wait and see if you're missing any 
libraries when you attempt to import them. All of 
the above packages are commonly used, so you 
should be able to install them using your distro’s 
package manager. 


0 The server 
The server will do the following jobs: 
» Listen for new clients 
° Notify all clients when a new client joins 
¢ Notify all clients when a client leaves 
« Receive and deliver messages to all clients 


We're going to write the server side of the 
instant messenger first, as the client requires 
it. There will be two code files, so it’s a good 
idea to make a folder to keep them inside. You 
can create an empty file with the command 
touch [filename], and mark that file as 
executable using chmod +x [filename]. This 
file is now ready to edit in your favourite editor. 


[Lliam@liam-laptop Python]$ mkdir 
Python-IM 

[Lliam@liam-laptop Python]$ cd 
Python-IM/ 

[liam@liam-laptop Python-IM]$ touch 
IM-Server. py 

[Lliam@liam-laptop Python-IM]$ chmod 
+x IM-Server.py 


'@) Starting off 


As usual, we need to start off with the 
line that tells the program loader what it needs 
to interpret the rest of the file with. In your 
advisor’s case, that line is: 


#!/usr/bin/env python2. 

On your system, it may need to be changed to 
#!/usr/bin/env/ python2.6 or #!/usr/ 
bin/env python2.7 


After that, we've written a short comment about 
what the application does, and imported the 
required libraries. We've already mentioned 
what the threading and libraries are 
for. The re library is used for searching strings 
with regular expressions. The library is 
used for dealing with signals that will kill the 
program, such as SIGINT. SIGINT is sent when 
Ctrl+C is pressed. We handle these signals so 
that the program can tell the clients that it’s 
exiting rather than dying unexpectedly. The sys 
library is used to exit the program. Finally, the 
time library is used to put a sensible limit on how 
frequently the body of while loops execute. 


#!/usr/bin/env python2 

# The server side of an instant 
messaging application. Written as 
part of a Linux User & Developer 
tutorial by Liam Fraser in 2013. 
import threading 


import socket 
import re 
import signal 
import sys 
import time 


0 The Server class 

The Server class is the main class of our 
instant messenger server. The initialiser of this 
class accepts a port number to start listening 
for clients on. It then creates a socket, binds the 
socket to the specified port on all interfaces, 
and then starts to listen on that port. You can 
optionally include an IP address in the tuple that 
contains the port. Passing in a blank string like 
we have done causes it to listen on all interfaces. 
The value of 1 passed to the listen function 
specifies the maximum number of queued 
connections we can accept. This shouldn't be 
a problem as we're not expecting a bunch of 
clients to connect at exactly the same time. 

Now that we have a socket, we'll create an 
empty array that will be later used to store a 
collection of client sockets that we can echo 
messages to. The final part is to tell the signal 
library to run the self.signal_handler function, 
which we have yet to write, when a SIGINT or 
SIGTERM is sent to the application so that we 
can tidy up nicely. 


class Server(): 
def __init__(self, port): 

# Create a socket and bind it to a 
port 

self.listener = socket. 
socket (socket.AF_INET, socket.SOCK_ 
STREAM) 

self.listener.bind((‘’, 
port)) 

self.listener.listen(1) 

print “Listening on port 
{0}”. format (port) 
# Used to store all of the client 
sockets we have, for echoing 
to them 

self.client_sockets = [] 
# Run the function self.signal_ 
handler when Ctrl+C is pressed 

signal.signal(signal.SIGINT, 
self.signal_handler) 

signal.signal(signal. 
SIGTERM, self.signal_handler) 


'@) The server’s main loop 

The server's main loop essentially 
accepts new connections from clients, 
adds that client’s socket to the collection of 


Useful 
documentation 


Threading: docs.python.org/2/library/ 
threading.html 


Sockets: docs.python.org/2/library/ 
socket.html 


Regular expressions: docs.python. 


org/2/library/re.html 


The signal handler: docs.python.org/ 
2/library/signal.html 


PyGTK: www.pygtk.org/ 
pygtk2reference 


GObject: www.pygtk.org/ 
pygtk2reference/gobject-functions.html 


sockets and then starts an instance of the 

class, which we have yet to 
write, in a new thread. Sometimes, defining 
interfaces you are going to call before you've 
written them is good, because it can give an 
overview of how the program will work without 
worrying about the details. 

Note that we’re printing information as we go 
along, to make debugging easier should we need 
to do it. Sleeping at the end of the loop is useful 
to make sure the while loop can’t run quickly 
enough to hang the machine. However, this is 
unlikely to happen as the line that accepts new 
connections is blocking, which means that the 
program waits for a connection before moving 
on from that line. For this reason, we need to 
enclose the line in a try block, so that we can 
catch the socket error and exit when we can no 
longer accept connections. This will usually be 
when we've closed the socket during the process 
of quitting the program. 


def run(self): 
while True: 
# Listen for clients, and create a 
ClientThread for each new client 
print “Listening for 
more clients” 


tiaye 
(client_socket, 
client_address) = self.listener. 
accept () 
except socket.error: 
sys.exit(“Could not 


/ 


ae 
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accept any more connections”) 


self.client_sockets. 
append(client_socket) 


print “Starting client 
thread for {0}”.format(client_ 
address) 

client_thread = 
ClientListener(self, client_socket, 
client_address) 

client_thread.start() 


time.sleep(Q@.1) 


O The echo function 

We need a function that can be called 
from aclient’s thread to echo a message to each 
client. This function is pretty simple. The most 
important part is that sending data to sockets is 
ina try block, which means that we can handle 
the exception if the operation fails, rather than 
having the program crash. 


def echo(self, data): 
# Send a message to each socket in 
self.client_socket 
print "echoing: {Q}". 
format (data) 
for socket in self.client_ 


sockets: 
# Try and echo to all clients 
try: 
socket .sendall (data) 
except socket.error: 
print "Unable to send 
message” 


06 Finishing the Server class 
The remainder of the Server class is 


taken up with a couple of simple functions; 
one to remove a socket from the collection of 
sockets, which doesn’t need an explanation, 
and the function that we talked 
about in the of the class. This function 
stops listening for new connections, and 
unbinds the socket from the port it was listening 
on. Finally, we send a message to each client to 
let them know that we are exiting. The signal will 
continue to close the program as expected once 
the signal_handler function has ended. 


def remove_socket(self, socket): 
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# Remove the specified socket from the 

client_sockets list 
self .client_sockets. 

remove (socket) 

def signal_handler(self, signal, 

frame) : 

# Run when Ctrl+C is pressed 
print "Tidying up” 

# Stop listening for new connections 
self.listener.close() 

# Let each client know we are quitting 
self .echo("QUIT”) 


0 The client thread 
The class that is used to deal with each 

client inherits the class. This means 
that the class can be created, then started with 
client_thread.start(). At this point, the 
code in the run function of the class will be run in 
the background and the main loop of the 
class will continue to accept new connections. 

We have to start by initialising the Thread base 
class, using the keyword. You may have 
noticed that when we created a new instance of 
the ClientListener class in the server's main loop, 
we passed through the server’s self variable. We 
do this because it’s better for each instance of the 
ClientListener class to have its own reference to 
the server, rather than using the global one that 
we'll create later to actually start the application. 


class ClientListener (threading. 
Thread) : 
def __init__(self, server, 

socket, address): 

# Initialise the Thread base class 
super (ClientListener, 

self).__init__Q 

# Store the values that have been 

passed to the constructor 
self.server = server 
self.address = address 
self.socket = socket 
self.listening = True 
self.username = "No 

Username" 


0 The client thread’s loop 

The loop that runs in the client thread 
is pretty similar to the one in the server. It keeps 
listening for data while is true, 
and passes any data it gets toa 
function that we will write shortly. The value 


passed to the socket.recv function is the size of 


the buffer to use while receiving data. 


def run(self): 
# The thread's loop to receive and 
process messages 
while self.listening: 


data = "” 
try: 
data = self.socket. 
recv(1024) 
except socket.error: 
"Unable to recieve 
data” 


self .handle_msg (data) 
time.sleep(Q.1) 
# The while loop has ended 
print "Ending client thread 
for {0}".format(self.address) 


'@) Tidying up 

We need to have a function to tidy up 
the thread. We'll call this either when the client 
sends us a blank string (indicating that it’s 
stopped listening on the socket) or sends us the 
string “QUIT”. When this happens, we'll echo to 
every client that the user has quit. 


def quit(self): 

# Tidy up and end the thread 
self.listening = False 
self.socket.close() 
self.server.remove_ 

socket (self .socket) 
self.server.echo("{@} has 

quit.\n”.format (self .username) ) 


1 @) Handling messages 


There are three possible messages our 
clients can send: 
° QUIT 
e USERNAME user 
» Arbitrary string to be echoed to all clients 


The client will also send a bunch of empty 
messages if the socket has been closed, so we 
will end their thread if that happens. The code 
should be pretty self-explanatory apart from 
the regular expression part. If someone sends 
the USERNAME message, then the server tells 
every client that a new user has joined. This is 
tested with a regular expression. i indicates the 
start of the string, 3 indicates the end, and the 
brackets containing * extract whatever comes 
after “USERNAME”. 


o We need to tell GObject that we'll be 


using threading il 


def handle_msg(self, data): 
# Print and then process the message 
we’ve just recieved 
print "{@} sent: {1}”. 
format(self.address, data) 
# Use regular expressions to test for 
a message like "USERNAME liam” 
username_result = 
re.search(’*USERNAME (.*)$’, data) 
if username_result: 
self.username = 
username_result.group(1) 
self.server.echo("{} 
has joined.\n".format(self. 
username) ) 
elif data == "QUIT": 
# If the client has sent quit then 
close this thread 
self .quitQ 
elif data == "”": 
# The socket at the other end is 
probably closed 
self .quit() 
else: 
# It's a normal message so echo it to 
everyone 
self.server.echo(data) 


1 Starting the server 

The code that actually starts the Server 
class is as follows. Note that you are probably 
best picking a high-numbered port as you need 
to be root to open ports <1024 


if __name__ == ” ie 
# Start a server on port 59091 
server = Server(59091) 


server.run() 


1 The client 

Create a new file for the client as we did 
for the server and open it in your favourite editor. 
The client requires the same imports as the 
server, as well as the gtk, gobject and datetime 
libraries. One important thing we need to do is to 
tell GObject that we'll be using threading, so we 
can call functions from other threads and have 
the main window, which is running in the main 
GTK thread, update 


#!/usr/bin/env python2 

# The client side of an instant 
messaging application. Written as 
part of a Linux User & Developer 
tutorial by Liam Fraser in 2013. 


import threading 
import gtk 
import gobject 
import socket 
import re 

import time 
import datetime 


# Tell gobject to expect calls from 
multiple threads 
gobject.threads_init() 


1 The client graphical user interface 

The user interface of the client isn’t 
he main focus of the tutorial, and won't be 
explained in as much detail as the rest of 
he code. However, the code should be fairly 
straightforward to read and we have provided 
inks to documentation that will help. 

Our class inherits the gtk 
Window class, so we need to start by initialising 
hat using the super keyword. Then we create 
he controls that will go on the window, connect 
any events they have to functions, and finally 
ay out the controls how we want. The destroy 
event is raised when the program is closed, and 
he other events should be obvious. 

GTK uses a packing layout, in which you use 
Vboxes and Hboxes to lay out the controls. V 
and H stand for vertical and horizontal. These 
controls essentially let you split a window 
up almost like a table, and will automatically 
decide the size of the controls depending on the 
size of the application. 

GTK doesn’t come with a control to enter 
basic information, such as the server’s IP 
address, port and your chosen username, so 
we've made a function called ; 
which creates a message box, adds a text 
box to it and then retrieves the results. We've 
done this because it’s simpler and uses less 
code than creating a new window to accept 
the information. 


/ 


class MainWindow(gtk.Window) : 

def __init__(self): 

# Initialise base gtk window class 
super(MainWindow, self).__ 

Invitea@) 

# Create controls 
self.set_title("IM Client”) 
vbox = gtk.VBox() 
hbox = gtk.HBox() 
self.username_label = gtk. 

Label () 
self.text_entry = gtk. 

Entry() 
send_button = gtk. 

Button("Send”) 
self.text_buffer = gtk. 

TextBuffer() 
text_view = gtk. 

TextView(self.text_buffer) 

# Connect events 
self.connect("destroy”, 

self.graceful_quit) 
send_button. 

connect("clicked”, self.send_ 
message) 

# Activate event when user presses 

Enter 


self.text_entry. 
connect("activate”, self.send_ 
message) 

# Do layout 
vbox.pack_start(text_view) 
hbox.pack_start(self. 

username_label, expand = False) 


— 


hbox.pack_start(self.text_ message_format = question) 1 The remainder of MainWindow 
entry) entry = gtk.Entry() The rest of the MainWindow class has 
hbox. pack_end(send_button entry. show() plenty of comments to explain itself, as follows 
expand = False) dialog. vbox.pack_end(entry) One thing to note is that when a client sends a 
vbox.pack_end(hbox, expand response = dialog.run() message, it doesn’t display it in the text view 
= False) response_text = entry. straight away. The server is going to echo the 
# Show’ ourselves get_text() ~ message to each client, so the client simply 
self .add(vbox) im dialog.destroy() displays its own message when the server 
self.show_allQ) if response == gtk.RESPONSE echoes it back. This means that you can tell if 
# Go through the configuration OK: ~ the server is not receiving your messages when 
process return response_text you don’t see a message that you send 
self.configure() else: 
def ask_for_info(self, return None def add_text(self, new_text): 
question): # Add text to the text view 


# Shows a message box with a text 
entry and returns the response 
dialog = gtk. 
MessageDialog(parent = self, type = 
gtk.MESSAGE_QUESTION, 


1 Configuring the client text_with_timestamp = "{0} 
This code is run after we've added the {1}". format (datetime.datetime.now(), 
controls to the main window, and asks the user 


for input. Currently, the application will exit ifthe — pew_text) 
user enters an incorrect server address or port; # Get the position of the end of 
but this isn’t a production system, so that’s fine. the text buffer, so we know where to 


a insert new text 
flags = gtk.DIALOG_MODAL | def configure(self): end_itr = self.text_buffer. 
gtk. DIALOG_DESTROY_WITH_PARENT, # Performs the steps to connect to get_end_iter() 
the server # Add new text at the end of the buffer 
buttons = gtk.BUTTONS_OK_CANCEL, # Show a dialog box asking for server self. text_buffer. insert (end_ 
address followed by a port itr, text_with_timestamp) 
server = self.ask_for_ def send_message(self, widget): 
info("server_address: port”) # Clear the text entry and send the 
# Regex that crudely matches an IP message to the server 
address and a port number # We don't need to display it as it 
regex = re.search('*(\d+\.\ will be echoed back to each client, 
d+\.\d+\.\d+):(\d+)$’, server) including us. 
address = regex.group(1). new_text = self.text_entry. 
stripQ get_text() 
port = regex.group(2). self.text_entry.set_text("") 
strip( message = "{Q} says: {1}\n”. 
# Ask for a username format(self.username, new_text) 
self.username = self.ask_ self .network.send(message) 
for_info(”username” ) def graceful_quit(self, widget): 
self.username_label.set_ # When the application is closed, 
text (self .username) tell GIK to quit, then tell the 
# Attempt to connect to the server server we are quitting and tidy up 
and then start listening the network 
self.network = gtk.main_quit() 
Networking(self, self.username, self .network.send("QUIT”) 
address, int(port)) self .network. tidy_up() 


self.network.listen() 


the server is going to echo the 
message to each client il 


1 The client’s Networking class 
Much of the client’s HEERARENG class is 
similar to that of the server’s. One difference is 


that the class doesn't inherit the Thread class — 
we just start one of its functions as a thread. 


class Networking(): 
def __init__(self, window, 
username, server, port): 
# Set up the networking class 
self .window = window 
self.socket = socket. 
socket (socket.AF_INET, socket .SOCK_ 
STREAM) 
self.socket.connect((server, 
port)) 
self.listening = True 
# Tell the server that a new user 
has joined 
self.send("USERNAME {@}". 
format (username) ) 


def listener(self): 
# A function run as a thread that 
listens for new messages 
while self.listening: 


data = "" 
try: 
data = self.socket. 
recv(1024) 
except socket.error: 
"Unable to recieve 
data” 


self .handle_msg (data) 
# Don't need the while loop to be 
ridiculously fast 

time.sleep(Q.1) 


17 Running a function as a thread 

The listener function above will be run 

as a thread. This is trivial to do. Enabling the 
option on the thread means that it will 

die ifthe main thread unexpectedly ends. 


def listen(self): 
# Start the listening thread 
self.listen_thread = 
threading. Thread(target=self. 
listener) 
# Stop the child thread from keeping 
the application open 
self.listen_thread.daemon = 
True 
self.listen_thread.start() 


1 8 Finishing the Networking class 
Again, most of this code is similar to 
the code in the server’s Networking class. One 


difference is that we want to add some things to 
the text view of our window. We do this by using 
the idle_add function of GObject. This allows 
us to call a function that will update the window 
running in the main thread when it is not busy. 


def send(self, message): 
# Send a message to the server 
print "Sending: {Q}”. 
format (message) 
try: 
self.socket. 
sendall (message) 
except socket.error: 
print "Unable to send 


message” 


def tidy_up(self): 

# We'll be tidying up if either we are 

quitting or the server is quitting 
self.listening = False 
self.socket.close() 

# We won't see this if it’s us 

that's quitting as the window will 

be gone shortly 
gobject.idle_add(self. 

window.add_text, "Server has 

quit.\n"”) 


def handle_msg(self, data): 
if data == "QUIT”: 
# Server is quitting 
self .tidy_up() 
elif data == "": 
# Server has probably closed 
unexpectedly 
self .tidy_up() 
else: 
# Tell the GTK thread to add some 
text when it’s ready 
gobject.idle_add(self. 
window. add_text, data) 


1 Starting the client 

The main window is started by initialising 
an instance of the class. Notice that we don’t 
need to store anything that is returned. We then 
start the GTK thread by calling 


if __name__ == "__main__”: 
# Create an instance of the main 
window and start the gtk main loop 
MainWindow() 
gtk.main() 


2 Trying it out 
You'll want a few terminals: one to 
start the server, and some to run clients. Once 


you've started the server, open an instance of 
the client and enter 127.0.@.1:port, where 
‘port’ is the port you decided to use. The server 
will print the port it’s listening on to make this 
easy. Then enter a username and click OK. Here 
is an example output from the server with two 
clients. You can use the client over a network 
by replacing 127.0.0.1 with the IP address of the 
server. You may have to let the port through your 
computer’s firewall if it’s not working. 


[liam@liam-laptop Python]$ ./IM- 
Server .py 

Listening on port 59091 

Listening for more clients 

Starting client thread for 
('127.0.0.1', 38726) 

('127.0.0.1', 38726) sent: USERNAME 
client1 

echoing: clientl has joined. 
Listening for more clients 

Starting client thread for 
('127.@.0.1', 38739) 

('127.0@.0.1', 38739) sent: USERNAME 
client2 

echoing: client2 has joined. 
Listening for more clients 


('127.0.0.1', 38739) sent: client2 
says: Hi 

echoing: client2 says: Hi 
('127.0.0.1', 38726) sent: client1 


says: Hi 

echoing: clientl says: Hi 
('127.0.0.1', 38726) sent: QUIT 
echoing: clientl has quit. 
Ending client thread for 
('127.0.0.1', 38726) 
“CTidying up 

echoing: QUIT 

Could not accept any more 
connections 

('127.0.0.1', 38739) sent: 
echoing: client2 has quit. 
Ending client thread for 
('127.0.0.1', 38739) 


2 That’s it! 

So, it’s not perfect and could be a little 
more robust in terms of error handling, but we 
have a working instant messenger server that 
can accept multiple clients and relay messages 
between them. More importantly, we have 
learned a bunch of new concepts and methods 


of working. 


/ 
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NI 


Replace your shell 
with Python 


Python is a great programming language, but did you know that 
it is even capable of replacing your primary shell Command-line 
interface)? Here, we explain all... 


Resources 


You will require a version of Python installed on 
your system. The good news is you don’t have to 
do anything to get it installed. Most of the Linux 
distributions already ship with either Python 2.6 or 
Python 2.7 
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We all use shell on a daily basis. For most 
of us, shell is the gateway into our Linux 
system. For years and even today, Bash has 
been the default shell for Linux. But itis getting a 
bit long in the tooth. 

No need to be offended: we still believe Bash 
is the best shell out there when compared to 
some other UNIX shells such as Korn Shell 
(KSH), C Shell (CSH) or even TCSH. 

This tutorial is not about Bash being 
incapable, but it is about how to breathe 
completely new life into the shell to do old 
things conveniently and new things which were 
previously not possible, even by a long shot. So, 
without further delay, let’s jump in. 


While the Python programming language 
may require you to write longer commands to 
accomplish a task (due to the way Python’s 
modules are organised), this is not something 
to be particularly concerned about. You can 
easily write aliases to the equivalent of the Bash 
command that you intend to replace. Most of 
the time there will be more than one way to do 
a thing, but you will need to decide which way 
works best for you. 

Python provides support for executing 
system commands directly (via the os or 
subprocess module), but where possible we will 
focus on Python-native implementations, as 
this allows us to develop portable code. 


SECTION 1: Completing basic shell 
tasks in Python 


1. File management 

The Python module shutil provides support for 
file and directory operations. It provides support 
for file attributes, directory copying, archiving 
etc. Let’s look at some of its important functions. 


shutil module 

copy (src,dst): Copy the src file to 
the destination directory. In this 
mode permissions bits are copied but 
metadata is not copied. 

copy2 (src,dst): Same as copy() but 
also copies the metadata. 
copytree(src, dstL, symlinks=FalseL, 
ignore=None]]): This is similar to ‘cp 
-r’, it allows you to copy an entire 
directory. 

ignore_patterns (*patterns): ignore_ 
patterns is an interesting function 
that can be used as a callable for 
copytree(), it allows you to ignore 
files and directories specified by the 
glob-style patterns. 

rmtree(pathL, ignore_errorsL, 
onerror]]): rmtree() is used to delete 
an entire directory. 

move(src,dst): Similar to mv command it 
allows you to recessively move a file 
or directory to a new location. 


Example: 

>>>from shutil import copytree, ignore_ 
patterns 

>>>copytree(source, destination, 
ignore=ignore_patterns(‘*.pyc’, 
“tmpx’)) 


make_archive(base_name, format[L, root_ 
dirL, base_dirL, verboseL, dry_runL, 
ownerL, groupL, logger]]]]]]] : Think 
of this as a replacement for tar, zip, 
bzip etc. make_archive() creates an 
archive file in the given format 

such as zip, bztar, tar , gztar. 
Archive support can be extended via 
Python modules. 


Example 

>>> from shutil import make_archive 
>>> import os 

>>> archive_name = os.path. 
expanduser (os.path.join(‘~’, 
“ludarchive’ )) 

>>> root_dir = os.path.expanduser (os. 


aos can easily write aliases to the 
equivalent of the Bash command that 
you intend to replace il 


path. join(‘~’, ‘.ssh’)) 

>>> make_archive(archive_name, ‘gztar’, 
root_dir) 
‘/Users/kunal/ludarchive. tar.gz’ 


2. Interfacing operating system & 
subprocesses 

Python provides two modules to interface 
with the OS and to manage processes, called 
os and subprocess. These modules allow you 
to interact with the core operating system 
shell and let you work with the environment, 
processes, users and file descriptors. 


The subprocess module was introduced to 
support better management of subprocesses 
(part of which already exists in the os 
module) in Python and is aimed to replace 
os.system, os.spawn*, oS.popen, popen2.* and 
commands.* modules. 


os module 
environ: environment represents 
environment variables in a string object. 


the OS 


example: 

>>> import os 

>>> os.environ 
{‘VERSIONER_PYTHON_PREFER_32_BIT’ : 
NOwee CaCI PES sc UiT=OmreeciERME 
PROGRAM_VERSION’: ‘297’, ‘LOGNAME’ : 
‘kunaldeo’, ‘USER’: ‘kunaldeo’, ‘PATH’: 
‘/System/Library/Frameworks/Python. 
framework/Versions/2.7/bin: /Users/ 
kunaldeo/narwhal/bin: /opt/local/sbin:/ 
usr/local/bin: /usr/bin: /bin: /usr/sbin: / 
sbin: /usr/local/bin: /usr/X11/bin: /opt/ 
local/bin: /Applications/MOTODEV_Studio_ 
For_Android_2.@.@_x86/android_sdk/ 
tools: /Applications/MOTODEV_Studio_For_ 
Android_2.@.@_x86/android_sdk/platform- 
tools: /Volumes/CyanogenModWorkspace/ 
bin’, ‘HOME’: ‘/Users/kunaldeo’ , 

*PS1’: ‘\\C\\eL0;32m\\]\\u\\C\\eLm\\] 
\AL\WeL1; 34m\\J\\w\\E\\eEm\\] \\ 
C\\eL1; 32m\\J\\$\\C\\eLm\\] \\ 
[C\\eL1;37m\\]’ , ‘NARWHAL_ENGINE’ : 


‘jsc’, ‘DISPLAY’: ‘/tmp/launch-s2LUfa/ 
org.x:@’, ‘TERM_PROGRAM’: ‘Apple_ 
Terminal’, ‘TERM’: ‘xterm-color’, 
‘Apple_PubSub_Socket_Render’: ‘/tmp/ 
launch-kDul5P/Render’ , ‘VERSIONER_ 
PYTHON_VERSION’: ‘2.7’, ‘SHLVL’: 

‘1’, ‘SECURITYSESSIONID’: ‘186a5’, 
‘ANDROID_SDK’: ‘/Applications/MOTODEV_ 
Studio_For_Android_2.@.@_x86/android_ 
sdk’ ,’_’: ‘/System/Library/Frameworks/ 
Python. framework/Versions/2.7/bin/ 
python’, ‘TERM_SESSION_ID’: ‘ACFE2492- 
BB5C-418E-8D4F-84E9CF63B506’ , ‘SSH_ 
AUTH_SOCK’: ‘/tmp/launch-dj6Mk4/ 
Listeners’, ‘SHELL’: ‘/bin/bash’, 
‘TMPDIR’: ‘/var/folders/6s/pgknm8b118 
737mb8psz8x4z80000gn/T/’ , ‘LSCOLORS’ : 
“ExFxCxDxBxegedabagacad’, ‘CLICOLOR’ : 
‘1’, ‘__CF_USER_TEXT_ENCODING’ : 
*Qx1F5:0:0’, ‘PWD’: ‘/Users/kunaldeo’ , 
“COMMAND_MODE’: ‘unix20Q3’ } 


You can also find out the value for an 
environment value: 

>>> os.environ[ ‘HOME’ ] 

‘/Users/kunaldeo’ 


putenv(varname,value) : Adds or sets 
an environment variable with the given 
variable name and value. 


getuid() : Return the current process’s 
user id. 
getlogin() : Returns the username of 


currently logged in user 

getpid(pid) : Returns the process group 
id of given pid. When used without 

any parameters it simply returns the 
current process id. 

getcwd() : Return the path of the 
current working directory. 

chdir(path) : Change the current 
working directory to the given path. 


—— 
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listdir(path) : Similar to ls, returns 
a list with the content of directories 
and file available on the given path. 


Example: 
>>> os. listdir(“/home/homer”’ ) 
[‘.gnome2’, ‘.pulse’, ‘.gconf’, 


‘.gconfd’, ‘.beagle’, ‘.gnome2_ 
private’, ‘.gksu.lock’, ‘Public’, 
“.ICEauthority’, ‘.bash_history’ , 


“.compiz’, ‘.gvfs’, ‘.update- 
notifier’, ‘.cache’, ‘Desktop’, 
‘Videos’, ‘.profile’, ‘.config’, 
*,esd_auth’, ‘.viminfo’, ‘.sudo_ 
as_admin_successful’, ‘mbox’, 
“.xsession-errors’, ‘.bashrce’, ‘Music’, 
‘.dbus’, ‘.local’, ‘.gstreamer-Q.10’, 
‘Documents’, ‘.gtk-bookmarks’ , 
‘Downloads’, ‘Pictures’, ‘.pulse- 
cookie’, ‘.nautilus’, ‘examples. 


desktop’, ‘Templates’, ‘.bash_logout’ ] 


mkdir(pathL, mode]) : Creates a 
directory with the given path with the 
numeric code mode. The default mode is 
Q777. 

makedirs(pathL, mode]) : Creates given 
path (inclusive of all its directories) 
recursively. The default mode is 0777. 


Example: 

>>> import os 

>>> path = “/home/kunal/greatdir” 
>>> os.makedirs( path, @755 ); 


rename (old,new) : The file or 
directory “old” is renamed to “new” 
If “new” is a directory, an error 
will be raised. On Unix and Linux, if 
“new” exists and is a file, it will 
be replaced silently if the user has 
permission to do so. 

renames (old,new) : Similar to rename 
but also creates any directories 
recessively if necessary. 

rmdir(path) : Remove directory from the 
path mentioned. If the path already 
has files you will need to use shutil. 
rmdtree() 


subprocess: 


call(xpopenargs, **kwargs) : Runs the 
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command with arguments. On process 
completion it returns the returncode 
attribute. 


Example: 

>>> import subprocess 

>>> print subprocess.call([“1ls”,”-17]) 
total 3684688 

5 kunaldeo staff 
170 Aug 19 01:37 Desktop 
drwx-----— + 10 kunaldeo staff 
340 Jul 26 @8:3@ Documents 
GW + 5@ kunaldeo staff 
1700 Aug 19 12:50 Downloads 
drwx-----~' @ 127 kunaldeo’ staff 
4318 Aug 19 01:43 Dropbox 

GW coor @ 42 kunaldeo staff 
1428 Aug 12 15:17 Library 
ClAWN==== S54 @ 3 kunaldeo staff 
102 Jul 3 23:23 Movies 

4 kunaldeo staff 
136 Jul 6 8:32 Music 

5 kunaldeo staff 
170 Aug 12 11:26 Pictures 
drwxr-xr-xt+ 5 kunaldeo staff 
170 Jul 3 23:23 Public 
-rwxr-xr-X 1 kunaldeo_ staff 
1886555648 Aug 16 21:02 androidsdk. tar 
drwxr-xr-x 5 kunaldeo staff 
170 Aug 16 21:05 sdk 
drwxr-xr-x 19 kunaldeo staff 
646 Aug 19 01:47 src 

Hie aap== 1 root staff 
367 Aug 16 20:36 umbrellad. log 


STD_INPUT_HANDLE: The standard input 
device. Initially, this is the console input buffer. 
STD_OUTPUT_HANDLE: The standard output 
device. Initially, this is the active console 
screen buffer. 
STD_ERROR_HANDLE: The standard error 
device. Initially, this is the active console 
screen buffer. 


SECTION 2: IPython: a ready-made 
Python system shell replacement 


In section 1 we have introduced you to the 
Python modules which allow you to do system 
shell-related tasks very easily using vanilla 
Python. Using the same features, you can build 
a fully featured shell and remove a lot of Python 
boilerplate code along the way. However, if 
you are kind of person who wants everything 


ready-made, you are in luck. Python provides a 
powerful and interactive Python shell which you 
can use as your primary shell. Python supports 
Python 2.6 to 2.7 and 3.1 to 3.2 . It supports 
two type of Python shells: Terminal based and 
Qt based. 


Just to reiterate, [Python is purely implemented 
in Python and provides a 100% Python- 
compliant shell interface, so everything you 
have learnt in section 1 can be run inside 
Python without any problems. 


Python is already available in most Linux 
distributions. Search your distro’s repositories to 
ook for it. In case you are not able to find it, you 
can also install it using easy_install or PyPI. 


Python provides a lot of interesting features 
which makes it a great shell replacement... 


Tab completion: Tab completion provides an 
excellent way to explore any Python object that 
you are working with. It also helps you to avoid 
making typos. 


Example: 

In [3]: import o {hit tab} 

objc opcode operator 
optparse os os2emxpath 
In [3]: import os 

In [4]: os.p {hit tab} 

os.pardir os.pathconf_names 
os. popen os. popen4 

os. path os.pathsep 

os. popen2 os.putenv 

os. pathconf os. pipe 

os. popen3 


Built In Object Explorer: You can add 
‘2’ after any Python object to view 
its details such as Type, Base Class, 
String Form, Namespace, File and 
Docstring. 


Example: 
In [28]: os.path? 
Type: module 


Base Class: <type ‘module’> 

String Form:<module ‘posixpath’ from 
‘/System/Library/Frameworks/Python. 
framework/Versions/2.7/lib/python2.7/ 
posixpath.pyc’> 

Namespace: Interactive 

File: /System/Library/Frameworks/ 


o [Python also comes with its own 
Qt-based console il 


Python. framework/Versions/2.7/lib/ 
python2.7/posixpath. py 

Docstring: 

Common operations on POSIX pathnames. 


Instead of importing this module directly, import 
os and refer to this module as os.path. The 
‘os.path’ name is an alias for this module on 
POSIX systems; on other systems (eg Mac, 
Windows), os.path provides the same operations 
in a manner specific to that platform, and is an 
alias to another module (eg macpath, ntpath). 


Some of this can actually be useful on non- 
POSIX systems too, eg for manipulation of the 
pathname component of URLs. 


You can also use double question marks (??) to 
view the source code for the relevant object. 


Magic functions: |Python comes with a set of 
predefined ‘magic functions’ that you can call 
with a command-line-style syntax. |Python 
‘magic’ commands are conventionally prefaced 
by %, but if the flag %automagic is set to on, 
then you can call magic commands without the 
preceding %. 

To view a list of available magic functions, 
you can use ‘magic function %lsmagic’. Magic 
functions include functions that work with code 
such as %run, %edit, Ymacro, %recall etc; 
functions that affect shell such as %colors, 
Yxmode, Y%autoindent etc; and other functions 
such as %reset, %timeit, Ypaste etc. Most of 
the cool features of [Python are powered using 
magic functions. 


Example: 

In [45]: %lsmagic 

Available magic functions: 

%alias %autocall %autoindent 
%automagic %bookmark %cd %colors 
%cpaste %debug %dhist %dirs 
%doctest_mode %ed edit %env %gui 
ahist *history %install_default_ 
config %install_profiles %load_ext 
%loadpy %logoff %logon %logstart 
%logstate %logstop %lsmagic %macro 
ymagic %page %paste %pastebin %pdb 


“pdef %pdoc %pfile %pinfo %pinfo2 
zpopd %pprint %precision %profile 
“prun %psearch %psource %pushd %pwd 
zpycat %pylab %quickref %recall 
wzrehashx %reload_ext %rep %rerun 
wzreset %reset_selective %run %save 
%sc %sx %tb %time %timeit %unalias 
%unload_ext %who %who_ls %whos 

%xdel %xmode 


Automagic is OFF, % prefix IS needed 
for magic functions 


To view help on any Magic Function, call 
‘Ysomemasgic?’ to read its docstring. 


Python script execution and runtime code 
editing: You can use %run to run any Python 
script. You can also control-run the Python 
script with pdb debugger using -d, or pdn 
profiler using -p. You can also edit a Python 
script using the %edit command. %edit will 
open the given Python script in the editor 
defined by the $EDITOR environment variable. 


Shell command support: If you are in the mood 
to just run a shell command, you can do it very 
easily by prefixing the command with !. 


Example: 
In [5]: !ps 

PID TTY TIME CMD 
4508 ttys00d @:00.07 -bash 
84275 ttys0@1 @:00.03 -bash 
17958 ttysee2 @:00.18 -bash 


In [8]: !clang prog.c -o prog 
prog.c:2:1: warning: type specifier 
missing, defaults to ‘int’ [-Wimplicit- 
int] 

main() 


Ann 


1 warning generated. 


Qt console : [Python also comes with its own 
Qt-based console. This provides a number of 
features that are only available in a GUI, such 
as inline figures, multiline editing with syntax 
highlighting, and graphical calltips . 


You can start the Qt console with: 
$ ipython qtconsole 


If you get errors related to missing modules, 
make sure that you have installed the dependent 
packages, such as PyQt, pygments, pyexpect 
and ZeroMQ. 


o | 
Python 2.6.5 (rae Tee), Agr 16 Dene, LST AL 
Tyee “copyright”, “credits” or “License” fer sure informetion 


IPythen @.21.alphal.git —. an endaneed interectine Python 
’ > Introduction and overview of tPythen's features 
Rgutcaret -> Quick reference 

help » Python's owe help tyeten 

obtect? «> Details stout ‘object’, ese “ebject!?” for entre details 
leulret » & belief reference stout the grephical weer beterfece 


in (1): run recare_sieple py 


Senrrec starora 0 the Pemaurys 


plotis, y, lanelr ® +) Be 
menLine(®, coler~ grees’, Label _selegent ) 


«i Shtlede Bevel functions £2_9¢«)8") 
Out [2]: cuatplotlib.tewt. test object at exTfeaderTesaer 


Bessel functions J. \« 


m |Python Qt console with GUI capabilities 


As you can see, it’s easy to tailor Python 
for all your shell environment needs. 
Python modules like os, subprocess 
and shutil are available at your 
disposal to do just about everything 
you need using Python. IPython turns 
this whole experience into an even 
more complete package. You get to do 
everything a standard Python shell 


does and with much more convenient 
features. |Python’s magic functions 
really do provide a magical Python shell 
experience. So next time you open a 
Bash session, think again: why settle for 


gold when platinum is a step away? 


/ 
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hon for system 
aaministrators 


Learn how Python can help in system administration as it dares to 
replace the usual shell scripting... 


Resources 


Python-devel Python development 
libraries, required for compiling 
third-party Python module 


setuptools setuptools allows you to 
download, build, install, upgrade, 
and uninstall Python packages 
with ease 


System administration is an important part of 
our computing environment. |t does not matter 
whether you are managing systems at your work 
our home. Linux, being a UNIX-based operating 
system, already has everything a system 
administrator needs, such as the world-class 
shells (not just one but many, including Bash, csh, 
zsh etc), handy tools, and many other features 
which make the Linux system an administrator's 
dream. So why do we need Python when Linux 
already has everything built-in? Being a dynamic 
scripting language, Python is very easy to read 
and learn. That’s just not us saying that, but 
many Linux distributions actually use Python 
in core administrative parts. For example, Red 
Hat (and Fedora) system setup tool Anaconda 
is written in Python (read this line again, got the 
snake connection’). Also, tools like GNU Mailman, 
CompizConfig Settings Manager (CCSM) and 
hundreds of tiny GUI and non-GUI configuration 
tools are written using Python. Python does not 
limit you on the choice of user interface to follow 
— you can build command-line, GUI and web apps 
using Python. This way, it has got covered almost 
all the possible interfaces. 

Here we will look into executing sysadmin- 
related tasks using Python. 
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Parsing configuration files 
Configuration files provide a way for applications 
to store various settings. In order to write a 
script that allows you to modify settings of a 
particular application, you should be able to 
parse the configuration file of the application. 
In this section we learn how to parse INI-style 
configuration files. Although old, the INI file 
format is very popular with much modern open 
source software, such as PHP and MySQL. 
[PHP] 

engine = On 
zend.zel_compatibility_mode = Off 
short_open_tag = On 

asp_tags = Off 

precision = 14 

y2k_compliance = On 

output_buffering = 4096 
;output_handler = 
zlib.output_compression = Off 


[MySQL] 

; Allow or prevent persistent links. 
mysql.allow_persistent = On 
mysql.max_persistent = 20 
mysql.max_links = -1 
mysql.default_port = 3306 
mysql.default_socket = 
mysql.default_host = localhost 
mysql.connect_timeout = 60 
mysql.trace_mode = Off 

Python provides a_ built-in module called 
ConfigParser (known as configparser in Python 
3.0). You can use this module to parse and create 
configuration files. 

(@code: writeconfig.py| 


adding MySQL section to the php.ini file. 


@warning: Do not use this script with the} 
handle all aspects of a complete php.ini file. 
import ConfigParser 

config = ConfigParser. 


RawConfigParser() 


config.add_section( ‘MySQL’ ) 
config.set( ‘MySQL’, ’mysql.trace_ 
mode’ , Off’) 
config.set( ‘MySQL’, ’mysql.connect_ 
timeout’ ,’6Q’) 
config.set( ‘MySQL’, ’mysql.default_ 
host’ ,’ localhost’) 
config.set( ‘MySQL’, ’mysql.default_ 
port’ ,’ 3306’) 
config.set( ‘MySQL’, ’mysql.allow_ 
persistent’, ‘On’ ) 
config.set( ‘MySQL’ , ’mysql.max_ 
persistent’ ,’ 20’) 


with open(‘php.ini’, 
configfile: 
config.write(configfile) 


‘ap’) as 


Output: php.ini 


[MySQL] 

mysql.max_persistent = 20 
mysql.allow_persistent = On 
mysql.default_port = 3306 
mysql.default_host = localhost 
mysql.trace_mode = Off 
mysql.connect_timeout = 60 


@code: parseconfig.py 


import ConfigParser 

config = ConfigParser.ConfigParser() 
config.read(‘php.ini’) 

# Print config values 

print config.get( ‘MySQL’ ,’mysql. 


LN To) x=) 
This is written for the Python 2.X series, 
as it is still the most popular and default 
across all the 


Python distribution 
platforms (including all Linux distros, 
BSDs and Mac OSX). 


default_host’) 

print config.get( ‘MySQL’, ’mysql. 

default_port’) 

config.remove_option( ‘MySQL’, ’mysql. 

trace_mode’ ) 

with open(‘php.ini’, 

configfile: 
config.write(configfile) 


Parsing JSON data 


JSON (also known as JavaScript Object 
Notation) is a lightweight modern data- 
interchange format. JSON is an open standard 
under ECMA-262. It is a text format and is 
completely language-independent. JSO 
is also used as the configuration file format 
for modern applications such as Mozilla 
Firefox and Google Chrome. JSON is also 
very popular with modern web services such 
as Facebook, Twitter, Amazon EC2 etc. In 

e 

g 

Ss 


‘wb’) as 


this section we will use the Python modu 
‘simplejson’ to access Yahoo Search (usin 
the Yahoo Web Services API), which outpu 
JSON data. 


you should have 


o use this section, 


Python module: simplejson. 

Note: You can install Python modules using the 
command ‘easy_install <module name>. This 
command assumes that you have a working 
internet connection. 

2. Yahoo App ID: The Yahoo App ID can be 
created from https://developer.apps.yahoo. 
com/dashboard/createKey.html. The Yahoo 
App ID will be generated on the next page. See 
the screenshot below for details. 


lm Generating the Yahoo App ID 


simplejson is very easy to use. In the following 
example we will use the capability of mapping 
JSON data structures directly to Python data 
types. This gives us direct access to the JSON 
data without developing any XML parsing code. 


JSON PYTHON DATA MAPPING 


object | dict 


string | unicode 


number (real) | float 


FALSE | FALSE 


For this section we will use the simplejson. 
load function, which allows us to deserialise a 
JSON object into a Python object. 
import simplejson, urllib 
APP_ID = ‘xxxxxxxx’ # Change this to 
your APP ID 
SEARCH_BASE = ‘http://search. 
yahooapis.com/WebSearchService/V1/ 
webSearch’ 


class YahooSearchError (Exception) : 
pass 


def search(query, results=20, 
start=1, **kwargs): 
kwargs.update({ 
‘appid’: APP_ID, 
‘query’: query, 
‘results’: results, 
‘start’: start, 
‘output’: ‘json’ 
}) 
url = SEARCH_BASE + ‘?’ + 
urllib.urlencode(kwargs) 
result = simplejson. load (urllib. 
urlopen(url)) 
if ‘Error’ in result: 
# An error occurred; raise 
an exception 
raise YahooSearchError, 
result[‘Error’ ] 
return result[ ‘ResultSet’ ] 
Let’s use the above code from the Python shell 
to see how it works. Change to the directory 
where you have saved the LUDYSearch.py and 
open a Python shell. 


>>> execfile(“LUDYSearch.py”) 

>>> results = search(‘Linux User and 
Developer’) 

>>> results[‘totalResultsAvailable’ ] 
123000000 


y/ 


>>> results[‘totalResultsReturned’ ] 
20 

>>> items = results[ ‘Result’ ] 

>>> for Result in items: 

aeons print 

Result[ ‘Title’ ],Result[ ‘Url’ ] 


Linux User http://www. linuxuser. 
co.uk/ 

Linux User and Developer - 
Wikipedia, the free encyclopedia 
http: //en.wikipedia. org/wiki/Linux_ 
User_and_Developer 

Linux User &amp;amp; Developer | 
Linux User http://www. linuxuser. 
co.uk/tag/linux-user-developer/ 


Gathering system 
information 


One of the important jobs of a system 
administrator is gathering system information. 
In this section we will use the SIGAR (System 
Information Gatherer And Reporter) API to 
demonstrate how we can gather system 
information using Python. SCAISSE Wes. 
complete API and it can provide lot o 
information, including the following: 
System memory, swap, CPU, load average, 
uptime, logins. 

2. Per-process memory, CPU, credential info, 
state, arguments, environment, open files. 

3. File system detection and metrics. 

etwork interface detection, configuration 
info and metrics. 

Na and UDP connection tables. 

etwork route table. 


Installing SIGAR 
The first step is to build and install SIGAR. SIGAR 
is hosted at GitHub, so make sure that you have 


$ git clone git://github.com/ 
hyperic/sigar.git sigar.git 

$ cd sigar.git/bindings/python 
$ sudo python setup.py install 


Python doesn’t 
limit your choice 
of interface il 


 —_ 
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At the end you should see a output similar to} 
he following : 


Writing /usr/local/lib/python2.6/ 
dist-packages/pysigar-®.1.egg-info 
SIGAR is a very easy-to-use library and can be 
used to get information on almost every aspect of 
asystem. The next example shows you how. 


ile system information 

import os 

import sigar 

sg = sigar.open() 

mem = sg.mem() 

swap = sg.swap() 

fslist = sg.file_system_list() 


Inftormat l0n==============" 
print “\tTotal\tUsed\tFree” 
print “Mem:\t”,\ 
(mem.total() / 1024), \ 
(mem.used() / 1024), \ 
(mem.free() / 1024) 
print “Swap:\t”, \ 
(swap.total() / 1024), \ 
(swap.used() / 1024), \ 
(swap.free() / 1024) 
print “RAM:\t”, mem.ram(), “MB” 
print “==========File System 
Information =SSS=====” 
def format_size(size): 
return sigar.format_size(size * 
1024) 
print ‘Filesystem\tSize\tUsed\ 
tAvail\tUse%\tMounted on\tType\n’ 
for fs in fslist: 
dir_name = fs.dir_name() 
usage = sg.file_system_ 
usage (dir_name) 
total = usage.total() 
used = total - usage. free() 
avail = usage.avail() 
pet = usage.use_percent() * 100 
if pct == 0.0: 
pet = ‘-’ 
print fs.dev_name(), format_ 
size(total), format_size(used), 
format_size(avail),\ 
pet, dir_name, fs.sys_type_ 
name(), ‘/’, fs.type_name() 


Total Used Free 
Mem: 8388608 6061884 2326724 
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Swap: 131072 16048 115024 
RAM: 8192 MB 
SSS=S======F ile System 


Information=============== 

Filesystem Size Used Avail 
Use% Mounted on Type 
/dev/diskQs2 300G 175G 124G 59.0 / hfs 
/ local 


devfs 191K 191K @ - /dev devfs / 
none 


Accessing Secure Shell 
(SSH) services 


SSH (Secure Shell) is a modern replacement for an 
old remote shell system called Telnet. It allows data 
to be exchanged using a secure channel between 
two networked devices. System administrators 
frequently use SSH to administrate networked 
systems. In addition to providing remote shell, SSH 
is also used for secure file transfer (using SSH File 
Transfer Protocol, or SFTP) and remote X server 
forwarding (allows you to use SSH clients as X 
server). In this section we will learn how to use the 
SSH protocol from Python using a Python module 
called paramiko, which implements the SSH2 
protocol for Python. 


paramiko can be installed using the following 


steps: 
$ git clone https://github.com/robey/ 
paramiko. git 
$ cd paramiko 
$ sudo python setup.py install 
To the core of  paramiko is _ the 
SSHClient class. This class 
wraps L{Transport}, {Channel}, and L{SFTPClient} 
to handle most of the aspects of SSH. You can use| 
client = SSHClient() 
client.load_system_host_keys() 
client.connect(‘some.host.com’ ) 
stdin, stdout, stderr = client.exec_ 
command( ‘dir’ ) 
The following example demonstrates a full SSH 
client written using the paramiko module. 
import base64, getpass, os, socket, sys, 
socket, traceback 
import paramiko 
import interactive 
# setup logging 
paramiko.util.log_to_file(‘demo_simple. 
log’) 
# get hostname 
username = ‘’ 
if len(sys.argv) > 1: 
hostname = sys.argv[1] 
if hostname. find(‘@’) >= Q: 
username, hostname = hostname. 


split(‘@’) 
else: 
hostname = raw_input(‘Hostname: ‘) 
if len(hostname) == Q: 
print ‘xxx Hostname required.’ 
sys.exit(1) 
port = 22 
if hostname.find(‘:’) >= @: 
hostname, portstr = hostname. 
split(‘:’) 
port = int(portstr) 
# get username 
if username == ‘’: 
default_username = getpass. 
getuser() 
username = raw_input( ‘Username 
[%s]: ‘ % default_username) 
if len(username) == 
username = default_username 
password = getpass.getpass( ‘Password 
for %s@%s: ‘ % (username, hostname) ) 
# now, connect and use paramiko 
Client to negotiate SSH2 across the 
connection 
try: 
client = paramiko.SSHClient() 
client. load_system_host_keys() 
client.set_missing_host_key_ 
policy(paramiko.WarningPolicy) 
print ‘x** Connecting...’ 
client.connect(hostname, port, 
username, password) 
chan = client. invoke_shell1() 
print repr(client.get_transport()) 
print ‘x** SSH Server Connected! 
kkk? 
print 
interactive. interactive_ 
shell (chan) 
chan.close() 
client.close() 
except Exception, e: 
print ‘***x Caught exception: %s: 
%s’ % (e.__class__, e) 
traceback.print_exc() 
ene 
client.close() 
except: 
pass 
sys.exit(1) 
To run this code you will also need a custom 
Python class interactive.py which implements 


Note 


If you are confused with the tab spacing of 


A dal-Kereye (Ma Cole) @iolmaa(-Kevele( Mall (=e) 0 atl (t=) Om 


the interactive shell for the SSH session. Look 
for this file on FileSilo and copy it into the same 
folder where you have created PySSHClient.py . 
kunal@ubuntu-vm-kdeo: ~/src/paramiko/ 
demos$ python demo_simple.py 
Hostname: 192.168.1.2 

Username [kunal]: luduser 

Password for luduser@192.168.1.2: 

*kxk Connecting... 

<paramiko.Transport at Qxb762@lacL 
(cipher aes128-ctr, 128 bits) 

(active; 1 open channel(s))> 

*xkk SSH Server Connected! xxx 

Last login: Thu Jan 13 02:01:06 2011 
from 192.168.1.9 

= S38) 

If the host key for the SSH server is not added 
*xkk Caught exception: <type 
‘exceptions. TypeError’>: unbound 
method missing_host_key() must be 
called with WarningPolicy instance 

as first argument (got SSHClient 
instance instead) 

This means that the client cannot verify the 
authenticity of the server you are connected 
to. To add the host key to known_hosts, you 
can use the ssh command. It is important 
to remember that this is not the ideal way to 
add the host key; instead you should use ssh- 
keygen. But for simplicity’s sake we are using 
the ssh client. 
kunal@ubuntu-vm-kdeo:~/.ssh$ ssh 
luduser@192.168.1.2 

The authenticity of host 
*192.168.1.2 (192.168.1.2)’ can’t be 
established. 

RSA key fingerprint is be:01:76:6a:b 
9:bb:69:64:e3:dc:37:00:a4:36:33:d1. 
Are you sure you want to continue 
connecting (yes/no)? yes 

Warning: Permanently added 
*192.168.1.2’ (RSA) to the list of 
known hosts. 

So now you've seen how easy it can be to 
carry out the complex sysadmin tasks using 
Python’s versatile language. 

As is the case with all Python coding, the 
code that is presented here can easily be 
adopted into your GUI application (with software 
such as PyGTK or PyQt) or a web application 
(using a framework such as Django or Grok). 


y/ 


Writing a user interface using Python 
Learn how to create a user-friendly interface using Python 


Administrators are comfortable with running raw 
scripts by hand, but end-users are not. So if you 
are writing a script that is supposed to be used by 
common users, it is a good idea to create a user- 
friendly interface on top of the script. This way 
end-users can run the scripts just like any other 
application. To demonstrate this, we will create 
a simple GRUB configuration tool which allows 
users to select default boot entry and the timeout. 
We will be creating a TUI (text user interface) 
application and will use the Python module 
B-Tar-\or am coMr-(or] Ui e-Ve-Maal ism (avo] mmol ol-Morelayav si-Yo 7100) 
the Python audio library, tksnack). 


his app consists of two files... 


g ')¥6 GRUB Config File (grub.conf) Parser 
(available on FileSilo). It implements two main 
functions, readBootDB() and _ writeBootFile(), 
which are responsible for reading and writing the 
GRUB configuration file. 


grub_tui.py-a mmm Lammn nt lgic( nC (el 


manipulating the GRUB configuration file using 
the functions available in grub.py. 


value=’1’ ,kernels=[]): 


(default_value, entry 
value, kernels)=readBootDB() 
except: 
print >> sys.stderr, 
(“Error reading /boot/grub/grub. 


sys.exit(10) 


screen=SnackScreen() 


while True: 
g=GridForm(screen, (“Boot 
configuration”) ,1,5) 
if len(kernels)>@ : 


li=Listbox(height=len(kernels), 


idth=20, returnExit=1) 
for i, x in 


li.setCurrent (default_value) 


bb = ButtonBar(screen, 


Fedora (2.625.645, 
Timeout (in seconds) BB 


COT”) 5 SOkaa) ie ((“Cancel”) , 
“cancel”))) 


gg.setField(1,0,0) 
gg.setField(e,1,0) 


g.add(Label(‘’),0,1) 


g.add(Label(‘’),@,3) 
g.add(bb,@, 4, growx=1) 
result = g.runOnce() 


bb.buttonPressed(result) == 
‘cancel’: 
screen. finish() 
sys.exit(Q) 


== ‘__main__’: 


Start the tool using the sudo 
command (as it reads the grub. 


$ sudo grub_tui.py 
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Program noughts and crosses 


112 Create two-step 


authentication 
UKM AW celary-licm-lUnaarcrararerclaceya 


116 Program a Space 


Invaders clone 
Make the basic Pivaders game 


120 Add animation and sound 
Enhance your Pivaders game 


124 Make a visual novel game 
Use Python to make a storytelling game 


128 Pygame Zero 


Turn your ideas into games 


108 “You'll be surprised by the 
diversity of what you can 


make with Python” 


@ wees ras 8 i 
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Build tic-tac-toe with Kivy 


Ease into the workings of Kivy by creating the pen-and-paper classic 
in just over 100 lines of Python... 


Kivy is a highly cross-platform graphical 
framework for Python, designed for the 
creation of innovative user interfaces like 
multitouch apps. Its applications can run not 
only on the traditional desktop platforms of Linux, 
OS X and Windows, but also Android and iOS, plus 
devices like the Raspberry Pi. 

That means you can develop cross-platform 
apps using Python libraries such as Requests, 
SQLAlchemy or even NumPy. You can even 
access native mobile APIs straight from Python 
using some of Kivy’s sister projects. Another 
great feature is the Cython-optimised OpenGL 
graphics pipeline, allowing advanced GPU effects 
even though the basic Python API is very simple. 

Kivy is a set of Python/Cython modules that 
can easily be installed via pip, but you'll need a 
few dependencies. It uses Pygame as a rendering 
backend (though its API is not exposed), Cython 
for compilation of the speedy graphics compiler 
internals, and GStreamer for multimedia. These 
should all be available through your distro’s 
repositories, or via pip where applicable. 

With these dependencies satisfied, you 
should be able install Kivy with the normal pip 
incantation. The current version is 1.8.0, and the 
same codebase supports both python2 and 
pythons. The code in this tutorial is also version- 
agnostic, running in python2.7 and python3.3. 


pip install kivy 
If you have any problems with pip, you can use 
easy_instalvia easy_install kivy. 


There are also packages or repositories available 
for several popular distros. You can find more 


You can develop 
cross-platform 
apps using various 
Python libraries i 
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information on Kivy’s website. A kivy application is 
started by instantiating and running an ‘App’ class. 
This is what initialises our pp’s window, interfaces 
with the OS, and provides an entry point for the 
creation of our GUI. We can start by making the 
simplest Kivy app possible: 


from kivy.app import App 


class TicTacToeApp(App): 
pass 

if _name__ == “__main__”: 
TicTacToeApp().run() 


You can already run this, your app will start up and 
you'll get a plain black window. Exciting! 

We can build our own GUI out of Kivy widgets. 
Each is a simple graphics element with some 
specific behaviour of its own ranging from 
standard GUI functionality (eg the Button, Labe 
or TextInput), to those that impose positioning on 
their child widgets (eg the BoxLayout, FloatLayou 
or GridLayout), to those abstracting a more 
involved task like interacting with hardware (eg 
the FileChooser, Camera or VideoPlayer). Mos 
importantly, Kivy’s widgets are designed to be 
easily combined - rather than including a widge 
for every need imaginable, widgets are kept simple 
but are easy to join to invent new interfaces. We'l 
see some of that in this tutorial. 

Since ‘Hello World!’ is basically compulsory in 
any programming tutorial, let’s get it over with by 
using a simple ‘Label’ widget to display the text: 


from kivy.uix.label import Label 


We'll display the ‘Label’ by returning it as our app’s 
root widget. Every app has a single root widget, the 
top level of its widget tree, and it will automatically 
be sized to fill the window. We'll see later how to 
construct a full GUI by adding more widgets for this 
one, but for now it’s enough to set the root widget 
by adding anew method to the App’: 


def build(self): 
return Label(text=’Hello World!’, 
font_size=100, 


m@ The classic ‘Hello World!’ in Kivy GUI form, 
using the built-in Label widget 


color=0, 1, 2, 1)) 


The ‘build’ method is called when the ‘App’ is run, 
and whatever widget is returned automatically 
becomes the root widget of that App’. In our case 
that’s a Label, and we've set several properties - 
the ‘text’, ‘font_size’ and ‘color’. All widgets have 
different properties controlling aspects of their 
behaviour, which can be dynamically updated to 
alter their appearance later, though here we set 
them just once upon instantiation. 

Note that these properties are not just Python 
attributes but instead Kivy properties. These are 
accessed like normal attributes but provide extra 
functionality by hooking into Kivy’s event system. 
We'll see examples of creating properties shortly, 
and you should do the same if you want to use your 
variables with Kivy’s event or binding functionality. 

That’s all you need to show some simple text, 
so run the program again to check that this does 
work. You can experiment with the parameters if it’s 
unclear what any of them are doing. 


Our own widget: tic-tac-toe 

Since Kivy doesn’t have a tic-tac-toe widget, we'll 
have to make our own! It’s natural to create a new 
widget class to contain this behaviour: 


from kivy.uix.gridlayout import GridLayout 
class TiclacToeGrid(Gridlayout): 
pass 


Now this obviously doesn’t do anything yet, 
except that it inherits all the behaviour of the 
Kivy GridLayout widget - that is, we'll need to 
tell it how many columns to have, but then it will 


mA tic-tac-toe grid now accepting input, adding a O or X alternately 


automatically arrange any child widgets to fit 
nicely with as many rows as necessary. Tic-tac-toe 
requires three columns and nine children. 

Here we introduce the Kivy language (kv), a 
special domain-specific language for making 
rules describing Kivy widget trees. It’s very simple 
but removes a lot of necessary boilerplate for 
manipulating the GUI with Python code - as a loose 
analogy you might think of it as the HTML/CSS to 
Python's JavaScript. Python gives us the dynamic 
power to do anything, but all that power gets in the 
way if we just want to declare the basic structure 
of our GUI. Note that you never need kv language, 
you can always do the same thing in Python alone, 
but the rest of the example may show why Kivy 
programmers usually like to use kv. 

Kivy comes with all the tools needed to use kv 
language; the simplest way is to write it ina file with 
aname based on our App class. That is, we should 
place the following in a file named ‘tictactoe.kv’: 


<TicTacToeGrid>: 
cols: 3 


This is the basic syntax of kv language; for each 
widget type we may write a rule defining its 
behaviour, including setting its properties and 
adding child widgets. This example demonstrates 


the former, creating a rule for the ‘TiclacToeGrid’ 
widget by declaring that every ‘TiclacToeGrid’ 
instantiated should have its ‘cols’ property set to 3. 

We'll use some more kv language features later, 
but for now let’s go back to Python to create the 
buttons that will be the entries in our tic-tac-toe grid. 


from kivy.uix.button import Button 
from kivy.properties import ListProperty 


class GridEntry(Button): 
coords = ListProperty([2, 2]) 


This inherits from Kivy’s ‘Button’ widget, which 
interacts with mouse or touch input, dispatching 
events when interactions toggle it. We can hook 
into these events to call our own functions when a 
user presses the button, and can set the button’s 
‘text’ property to display the ‘Xx’ or ‘O”.. We also 
created a new Kivy property for our widget, ‘coords’ 
— we'll show how this is useful later on. It’s almost 
identical to making a normal Python attribute by 
writing ‘self.coords = [0, OJ’ in‘GridEntry.__init__. 

As with the ‘TicTacToeGrid’, we'll style our new 
class with kv language, but this time we get to see 
amore interesting feature. 
<GridEntry>: 

font_size: self.height 


Kivy comes 
with all the tools 
needed to use kv 
language il 


As before, this syntax defines a rule for how a 
‘GridEntry’ widget should be constructed, this 
time setting the ‘font_size’ property that controls 
the size of the text in the button’s label. The extra 
magic is that kv language automatically detects 
that we've referenced the Button’s own height and 
will create a binding to update this relationship 
— when a ‘GridEntry’ widget’s height changes, its 
‘font_size’ will change so the text fits perfectly. 
We could have made these bindings straight 
from Python (another usage of the ‘bind’ method 
used later on), but that’s rarely as convenient as 
referencing the property we want to bind to. 

Let's now populate our ‘TicTacToeGrid’ with 
‘GridEntry’ widgets (Fig.01). This introduces a 
few new concepts: When we instantiated our 
‘GridEntry’ widgets, we were able to set their 
‘coords’ property by simply passing it in as a 
kwarg. This is a minor feature that is automatically 
handled by Kivy properties. 

We used the ‘bind’ method to call the 


grids ‘button_pressed’ method whenever 
the GridEntry widget dispatches an 
‘on_release’ event. This is automatically 
handled by its ‘Button’ superclass, and 


will occur whenever a user presses, then 
releases a ‘GridEntry’ button. We could also 
bind to ‘on_press’, which is dispatched when the 
button is first clicked, or to any Kivy property of 
the button, which is dispatched dynamically 
whenever the property is modified. 

We added each ‘GridEntry’ widget to our ‘Grid’ 
via the ‘add_widget’ method. That means each 
one is a child widget of the ‘TicTacToeGrid’, and 
so it will display them and knows it should 
automatically arrange them into a grid with the 
number of columns we set earlier. 

Now all we have to do is replace our root widget 
(returned from ‘App.build’) with a ‘TicTacToeGrid’ 
and we can see what our app looks like. 


— 
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def build(self): 
return TicTacloeGridQ) 


With this complete you can run your main Python 
file again and enjoy your new program. All being 
well, the single Label is replaced by a grid of 
nine buttons, each of which you can click (it will 
automatically change colour) and release (you'll 
see the printed output information from our 
binding). We could customise the appearance by 
modifying other properties of the Button, but for 
now we'll leave them as they are. 


Has anyone won yet? 

We'll want to keep track of the state of the board to 
check if anyone has won, which we can do with a 
couple more Kivy properties: 


from kivy.properties import <4 
(ListProperty, NumericProperty) 


class TiclacToeGrid(Gridlayout): 
status = ListProperty([2, 2, 2, 
Q, 2, 2, 
Q, 2 @)) 
current_player = NumericProperty(1) 


This adds an internal status list representing who 
has played where, and a number to represent the 
current player (1 for ‘O’, -1 for ‘X’). By placing these 
numbers in our status list, we'll know if somebody 
wins because the sum of a row, column or diagonal 
will be +-3. Now we can update our graphical grid 
when amoveis played (Fig. 02). 

You can run your app again to see exactly what 
this did, and you'll find that clicking each button 
now places an ‘O’ or ‘X’ as well as a coloured 
background depending on whose turn it is to 
play. Not only that, but you can only play one 
move in each button thanks to our status 
array keeping track of existing moves. 

This is enough to play the game but there’s one 
vital element missing... a big pop-up telling you 
when you've won! Before we can do that, we need 
toadd some code to check if the game is over. 

Kivy properties have another useful feature 
here, whenever they change they automatically 
call an ‘on_propertyname’ method if it exists 
and dispatch a corresponding event in Kivy’s 
event system. That makes it very easy to write 
code that will run when a property changes, 
both in Python and kv language. In our case 
we can use it to check the status list every time 
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X to play 


reset 


™ The game with final additions, making the grid square and extending the interface 


it is updated, doing something special if a player 
has filled a column, row or diagonal. 


def on_status(self, instance, new_value): 
status = new_value 


sums = [sum(status[2:3]), 
sum(status[3:6]), 
sum(status[6:9]), 
sum(status[2::3]), 
sum(status[1::3]), 
sum(status[2::3]), 
sum(status-::4]), 
sum(status[2:-2:2])] 


if 3 in sums: 
print(‘Os win!’) 

elif -3 in sums: 
print(‘Xs win!’) 

elif @ not in self.status: 
print(‘Draw!’) 


This covers the basic detection of a won or drawn 
board, but it only prints the result to stdout. At this 
stage we probably want to reset the board so that 
the players can try again, along with displaying a 
graphical indicator of the result (Fig. 03). 

Finally, we can modify the “on_status method 
to both reset the board and display the winner 
ina‘ModalView widget. 


from kivy.uix.modalview import ModalView 


This is a pop-up widget that draws itself on top of 
everything else rather than as part of the normal 
widget tree. It also automatically closes when the 
user clicks or taps outside it. 


winner = None 
if -3 in sums: 
winner = ‘Xs win!’ 
elif 3 in sums: 
winner = ‘Os win!’ 
elif @ not in self.status: 
winner = ‘Draw...nobody wins!’ 


if winner: 
popup = ModalView(size_hint=0.75, @.5)) 
victory_label = Label(text=winner, 


font_size=50) 
popup.add_widget(victory_label) 
popup. bind(on_dismiss=self.reset) 
popup.open() 


This mostly uses the same ideas we already 
covered, adding the ‘Label widget to the 
‘ModalView’ then letting the ‘ModalView’ take 
care of drawing itself and its children on top of 
everything else. We also use another binding; this 
time to ‘on_dismiss’, which is an event dispatched 
by the ‘ModalView’ when it is closed. Finally, we 
made use of the ‘size_hint’ property common 
to all widgets, which in this case is used to set 
the ‘ModalView’ size proportional to the window 
— while a ‘ModalView’ is open you can resize 
the window to see it dynamically resize, always 
maintaining these proportions. This is another trick 
made possible by a binding with the ‘size_hint’ Kivy 
property, this time managed internally by Kivy. 

That's it, a finished program! We can now 
not only play tic-tac-toe, but our program 
automatically tells us when somebody has won, 
and resets the board so we can play again. Simply 
run your program and enjoy hours of fun! 


Time to experiment 

This has been a quick tour through some of Kivy’s 
features, but hopefully it demonstrates how 
to think about building a Kivy application. Our 
programs are built from individual Kivy widgets, 
interacting by having Python code run when their 
properties change (eg our ‘on_status’ method) 
or when they dispatch events (eg ‘Button’ ‘on_ 
release). We also briefly saw kv language and 
experienced how it can automatically create 
bindings between properties. 

You can find a copy of the full program on 
FileSilo, which you can reference to check you've 
followed everything correctly. We've also added 
an extra widget, the ‘Interface’, with a structure 
coded entirely in kv language that demonstrates 
how to add child widgets this way. You can test 
it by uncommenting the ‘return Interface()’ line 
in ‘TicTacToeGrid.build’. It doesn’t do anything 
undamentally different to what we already 
covered, but it does make extensive use of kv 
anguage’s binding ability to automatically update 
a label showing the current player, and to resize 
the TicTacloeGrid so that it is always square to 
it within its parent. You can play with all these 
settings to see exactly how it fits together, or try 
things like swapping out the different widget types 


tosee how other widgets behave. 


/ 


Try swapping out the different widget 
types to see how other widgets behave iil 


class TicTacToeGrid(GridLayout): 
def __init__(self, xargs, **kwargs): 
super(TicTacToeGrid, self).__init__(«args, **kwargs) 
for row in range(3): 
for column in range(s): 
grid_entry = GridEntry( 
coords=(row, column)) 

grid_entry.bind(on_release=self.button_pressed) 
self.add_widget(grid_entry) 


def button_pressed(self, instance): 


print({{} button clicked!’.format(instance.coords)) 


def button_pressed(self, button): 


player = {1: ‘0’, -l: ‘X’} 
colours = {1: (1, 2, @, 1), -1: @, 1, 2, 1} 


row, column = button.coords 


status_index = 3*row + column 
already_played = self.status[status_index] 


if not already_played: 
self.status[status_index] = self.current_player 
button.text = {1: ‘0’, -1: ‘X’}[self.current_player] 
button.background_color = colours[self.current_player] 
self.current_player *= -1 


def reset(self, xargs): 
self.status = [0 for _ in range(9)] 


for child in self.children: 
child.text = °’ 
child.background_color = (1, 1, 1, 1) 


self.current_player = 1 
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Create a two-step 
authentication with Twilio 


Increase security in access to your web services 
by building a simple two-step authentication 
with Twilio’s SMS APIs to help you 


Resources 
Python 2.7+ 
Flask 0.10.0: 


flask.pocoo.org/ 


Flask Github: 


github.com/mitsuhiko/flask 
A Twilio account: 


twilio.com 


Twilio’s Python REST 
API Helper Library: 


github.com/twilio/twilio-python/zipball/master 


MySQLDB: 


mysql-python.sourceforge.net 


@ sweowe 


sid 


Today's Calis 


Telephony is one of the most versatile 
technologies in our households. Despite being 
invented over 100 years ago, we still use the 
same basic infrastructure that once only carried 
the voices of people to deliver a rich multitude of 
media content at incredible speeds. As is often 
the case with wonderful things, they can often be 
complex too — and yet phones are more important 
now to our daily lives than ever. So, what can we 
do to leverage some of that versatile technology? 

Well, for starters we can use an API. Twilio 
has created a RESTful API that removes a great 
deal of that complexity of telephony so that we 
can write apps and services that are able to 
deliver and receive both phone calls and SMS 
using various endpoints and services. Neat! In 
this tutorial, we're going to look at using Twilio 
to help us create the basic flow for a two-step 
authentication system for logging into a service. 
We're also going to be using Flask to help us 
create our routes and generate our pages, but 
little of Flask’s detail will be covered here. 


— 


TOKEN 


Today's SMS Messages 


@ The Twilio interface is kept nice and simple — no unnecessary complications here 
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'@) Get a Twilio account and 
phone number 

Signing up to Twilio is pretty easy. First, head 
over to http://twilio.com and click the ‘Signup’ 
button. At this point, the sign-up process 
doesn’t really differ from any other service, 
but after you’ve entered an email address and 
password you'll be asked for a phone number. 
Given the nature of Twilio’s API, it makes sense 
for them to ask whether we’re human, and 
having them text us is a good way to confirm 
that. Hey, it’s a two-step authentication, which 
is exactly what we're working towards. 

You can enter any number you have access 
to, be it a landline or mobile, to confirm who 
you are, but at this point we suggest you 
authenticate using a phone that can accept 
SMS (instead of a landline). Having entered your 
number, you'll receive a text to authenticate 
your phone — enter it and you'll be presented 
with a Twilio phone number. This is your Twilio 
phone number and you'll be using it to send and 
receive our authentication texts. 


O Add credit 

Just like a mobile phone operator, 
Twilio is not a free service — although it is very 
inexpensive. In order to continue, we'll need 
o add a card and some funds to our newly 
created Twilio account. On the main page of the 
dashboard, you'll see a big blue dialog asking 
oO upgrade your trial account; click through 
and follow the instructions to add a card and 
he amount of credit you would like to use. The 
minimum amount of $20 (around £10 GBP) will 
be more than plenty for this and other projects. 
Once that’s done, you're almost ready to start 
sending text messages — but first head back 
over to the Twilio dashboard and copy your 
account SID and auth token down somewhere, 
you'llneed those a little later. 


0 Install the Twilio Helper Library 
and MySQLDB 

The Twilio helper library is a fantastic piece of 

code that lets you jump straight into sending and 

handling text messages in no time at all. There 

are a couple of ways to install the library: you can 

use either PIP or Easy_Install, like so 


$ pip install twilio 
$ easy_install twilio 


Or you can download the source code for the 
helper library and run the ‘setup.py’ file. It 
really is as simple as that. Now, for storing the 
verification tokens we're going to use a MySQL 
database. To get Python talking to our SQL 
server, we'll use the Python module MySQLDB, 
the package for which you can grab like so... 


apt-get install python-mysqldb 


In the tutorial resources we have included an 
SQL dump with the table structure. Import it 
into a database of your choosing. Assuming 
everything so far has gone swimmingly, you can 
create a new project folder/environment and 
add a new file ‘server.py’. 
@) Server setup 
Open the ‘server.py’ file for editing. The 

first thing we're going to do is import the libraries 
we need for our authentication flow, create the 
endpoints for our server and assign some of the 
variables needed to run our Flask server. (Fig 01) 

You may have noticed the account_sid and 
auth_token variable we've set after the import 
statements. We'll use these with our Twilio 
client so we can interact with Twilio and our 
mobile phones. These settings can be found 
on the Twilio account dashboard, right below 
the header. We've also connected to our SQL 
database, so make sure your SQL server is 
running before you fire up the app, otherwise 
you'll have an error thrown. Save, now if you run 
your ‘server.py’ file, you should be able to access 
the index page of your server at 127.0.0.1:5000/. 

Server logic 


0 If you've hit all of your server endpoints 
already, so far all you will see are the strings we 
returned at the end of endpoint declarations. 
These are not all that good-looking, so let’s 
add some Flask templates to pretty things 
up a little. The focus of this tutorial is not on 
the intricacies of Flask and as such, included 
on the DVD is a folder called ‘templates’ and 
another called ‘static’; copy them both to the 
root of your current project folder and amend 


import MySQLdb 


/- 


from flask import Flask, redirect, request, session, render_template 
from twilio.rest import TwilioRestClient as twilio 


import string, random, time 


db = MySQLdb. connect (host="127.0.9.1", user="SOLUSER", 
passwd="SQLPASS", «1 db="two-step", port=3306) 


expirationLength = 300 


account_sid = "YOUR ACCOUNT SID” 


auth_token = "YOUR ACCOUNT AUTH TOKEN” 
client = twilio(account_sid, auth_token) 


@app.route('/') 
def index(): 
return "index page” 


@app.route('/login', methods=['GET']) 


def login(): 
return "login page” 


@app. route('/check-user’, methods=['POST']) 


def checkUser(): 
return "check user page” 


@app. route('/logout') 
def logout(): 
return "logout page” 


@app.route('/verify'’, methods=['GET']) 


def twoStep(): 
return "verify page” 


@app.route('/check-code’, methods=['POST']) 


def checkCode(): 
return "check code page” 


‘__main__' 


if __name__ == 


app.secret_key = 'R4nDOMCRypt@gr4phicK3yf@R5355i@N' 
app.run(host='0.0.0.0', debug=True) 


your endpoints as in Fig 02. If you revisit the 
pages again, things might seem a little out of 
whack at the moment, but don’t worry about 
that for the time being. It’s mostly because 
we've not put together the server logic to help 
the templates figure out what to do. 

Let’s deal with the 7 path first. All we're 
doing here is checking the state of our session 
cookies and effecting how the index.html 
page renders according to that state. If the 
user isn’t logged in, we'll give them a link to the 
login page, if the user is logged in but hasn't 
verified, then we'll give them a link to the 
code verification page. Before we deliver the 
template we need to check that our session has 


its particular variables set, otherwise we'll end 
up getting KeyErrors. 


@app.route(‘/’) 
def index(): 


checkSessionState() 


return render_template( incex. 
html’) 


def checkSessionState(): 


, 
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ery: 
session[‘verified’] == True 
except KeyError: 
session[‘verified’] = 


try: 
session[‘ loggedin’] == True 
except KeyError: 
session[ oseed in ] = 


try: 

session[‘user’] == True 
except KeyError: 

session[ user’ J =) 


06 Logging in 
The first step in two-step authentication 


is logging in with a traditional username/email 
and password. Access your database and create 
anew user with the following query: 


INSERT INTO users (username, password, «1 
phonenumber) VALUES (4 U5-2\ANe, OA et 
PASSWORD’, ‘+44YOURUSERSPHONENUMBER') 


For the purposes of this tutorial, the password 
is plain text — but we implore you, when you’re 
implementing passwords in a live environment, 
make sure that you hash them. Still, for now we're 
going to use a plain text password. Our login.html 
emplate has a form that’s going to POST itself 
o check-user; here we'll check the validity of 
he credentials and then trigger the verification 
if needed. So we're going to use the MySQLDB 
module to get details from our database. 

In order to query our database we need to 
create a cursor from which to execute our MySQL 
statements. We do this with cur = db.cursor(): 


@app. route(‘/check-user’, 
methods=[ ‘POST ']) 
def checkUser(): 


if request.method == ~0°' : 


cur = db.cursor() 


cur.execute("" "SELECT * FROM 
users WHERE username = %s"""", <4 


? 


(request. formL username J,)) 
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result = cur. fetchone() 
returnedPassword = result[2] 
returnedPhoneNumber = result[3] 


We can then build an SQL statement using cur. 
execute(). Notice the %s; this will be replaced with 
the value passed through in the next variable. We 
execute the statement with cur.fetchone(), which 
will get us the first row that the query returns — if 
there is no result we'll get None and we can then 
return the user to the login page with an error 
message. Let’s assume we've requested a valid 
user — we'llnext check that the password assigned 
tothat user is the same asthe one submitted. If so, 
we'll generate the validation code to send to the 
user, which we'll store in the verification table of 
our database untilit’s used or expires. We'llneed to 
create a new cursor to insert the verification code 
into our table. After we've executed the statement 
we need to commit the changes to the database, 
we do this with db.commit() — we'll then add the 
results of the query to our session so we can check 
against them later. (Fig 03) 


07 Send the verification code 

Now that we believe we're dealing with 
a valid user, it’s time for the second step of our 
two-step process. On the line after where we 
stored a variable in our session, we make acall 
to sendVerificationCode (VERIFICATION 
CODE, USER PHONE NUMBER) and pass 
through the code we want to send to our user 
and the user’s phone number. So what does 
that function actually look like? It must be 
big, long and complicated because it deals 
with the telecommunications network, right? 
Wrong. It’s actually incredibly simple to send 
an SMS with Twilio. In fact, part of the inherent 
beauty of Twilio lies in its simplicity. To send a 
text, all we have to dois: 


def sendVerificationCode(code, 
number): 


text = client.messages.create( 
body=“Your verification code 
is:” «+ code, 
to=number , 
from_=“+YOURTWILIONUMBER” 
) 


return text.sid 


Using the client variable we used to instantiate 
the Twilio REST module, we can access the 
messages class and execute the create 
method. All we need to pass through is the text 


that will make up the body of our message, 
the number that we want to send it to and the 
number that we want to send it from. When 
inputting the number that we want to send it 
to, it’s best to use the +CountryCode type of 
phone number to avoid any ambiguity about 
the intended recipient. The number that we're 
sending from is our Twilio number; you can 
use any Twilio number you have assigned to 
your account, so long as it has credit. As soon 
as we execute that code, the message will be 
sent and your SMS will go straight through to 
the telephone. The SID is the unique identifier 
for the message/call sent; receiving it means 
the message has been executed successfully. 
After that, we can redirect our user to the 
verification page with return  redirect(‘/ 
verify’) at the end of /check-user. 


@) Check verification code 
At this point the user will have received 
a text message with something along the lines 
of ‘Your verification code is: 12cd56’ and wil 
be presented with the verification page. If, at 
this point, they choose to browse around our 
site, they won't be able to access anything that 
we don't want them to. Still, we'll know that 
they've logged in, so if they head back to the 
verification page, we can just let them inpu 
their code. Once they submit their code, it wil 
be sent to the /check-code endpoint. 
Just like before when we checked for our 
user’s validity, we're going to attempt to retrieve 
the verification code and check it. (Fig 04) 
First we're simply going to retrieve the code 
and check the user it has assigned to it. If that 
user assigned to the code matches the user 
in our session, then we can be certain that 
the right person is logging in with the right 
code — if not we can redirect them accordingly. 
Assuming the code is correct, we need to 
check it’s still valid. Back in Step 6, we created 
an expiration time that was five minutes in the 
future from when the code was generated. If it’s 
been more than five minutes (or whatever time 
you've set on it) then we're going to consider it 
invalid, delete the code from our table and then 
log out our user so they can start over, like so. 


elif time.time() > expirationTime: 
expirySQL = db.cursor() 


expirySQL.execute( 9 0FL ee Foy 
« 
verification WHERE code=%s""", «J 
(codeToCheck, )) 


expirySQL.close() 
session[' loggedin’] == False 


return redirect( /logout’) 


If we manage to pass the tests so far, then 
we've two-step verified our user — hooray! 
Surprisingly easy, eh? Before we give our user 
free reign around our service, we still want 
to get rid of that token — we don't need it any 
more and we don’t want to risk someone else 
using it maliciously in the future. 


else: 
delSql = db.cursor() 


delSql.execute( DEL te FP Roy 
verification WHERE code=%s""", <4 
(codeToCheck, )) 


delSql.close() 

db. commit () 
session['verified'] = True 
return redirect( / ) 


else: 
return redirect( / 
verify?error=true') 


And that’s it! Now we redirect our user to 
wherever we want them to be at the end of the 
process. In this instance we're sending them 
back to our index page, which will render a 
success message and give the user a link to 
log out whenever they like — but they could be 
redirected to their user page, and so on. 


O Conclusion 

In every web-based service, security 
is king. Users entrust more and more personal 
data and trends to services every day and it’s 
the responsibility of those services to maintain 
the privacy of that data as best they can. It’s no 
wonder that services such as Amazon, Google 
and Facebook have all implemented two- 
step verification across their services. With 
two-step authentication, a user can tie their 
account to one of the most personal things they 
own: their phone. With services like Twilio and 
some simple code, they contain people's keys — 


or at least a part of them. 


@app.route('/') 
def index(): 
return render_template( | index.html’) 


@app.route(’/login'’, methods=['GET']) 
def login(): 
return render_template( (oein. vim!) 


@app.route('/check-user’, methods=[’POST']) 
def checkUser(): 
return "check user page” 


@app.route('/logout') 
def logout(): 
return "logout page” 


@app.route(’/verify', methods=['GET']) 
def twoStep(): 
return render_template( verity.htm.') 


@app.route('/check-code’, methods=[’POST']) 
def checkCode(): 
return "check code page” 


verficationCode = generateVerificationCode(size=6) 
ins = db.cursor() 


expiration = int(time.time() + expirationLength) 


sql = "INSERT INTO verification (code, expiration, username) VALUES ('%s', 


Sos) et os)” % (verficationCode, expiration, request.form[ usornone J) 


ins.execute(sql) 
ins.close() 
db. commit () 


session[ iso) J] = request.form[ username J 
session[’ loggedin’] = True 


@app.route(’/check-code’, methods=['POST']) 
def checkCode(): 


if request.method == 905: 
codeToCheck = request.form[ oo: > J 


if not ‘user’ in session: 
return redirect('/login’) 
else: 
cur = db.cursor() 


cur.execute("""SELECT * FROM verification WHERE code 


result = cur.fetchone() 

cur.close() 

if result != None: 
returnedUser = result[3] 


expirationTime = int(result[2]) 


if returnedUser != session[ «>> J: 
return redirect(’/verify?error=true') 


, (codeToCheck, )) 
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SCORE O 


Space Invaders clone 


Write your own RasPi shooter in 300 lines of Python 


Resources 


Raspbian: www.raspberrypi.org/ 
downloads 


Python: www.python.org/doc 
Pygame: www.pygame.org/docs 


When you’re learning to program in 
a new language or trying to master 
a new module, experimenting with a 
familiar and relatively simply project 
is a very useful exercise to help 
expand your understanding of the 
tools you’re using. Our Space Invaders 
clone is one such example that lends 
itself perfectly to Python and the 
Pygame module - it’s a simple game 
with almost universally understood 
rules and logic. While the Invaders 
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meander their way down the screen 
towards you, it’s your job to pick them 
off while dodging their random fire. 
When one wave is conquered, another 
faster, more aggressive wave appears. 
We've tried to use many features of 
Pygame, which is designed to make 
the creation of games and interactive 
applications easier. We’ve extensively 
used the Sprite class, which saves 
dozens of lines of extra code in making 
collision detection simple and updating 
the screen and its many actors a 
single-line command. 

We hope you agree that this is an 
exciting game to play and a great 
tool to learn more about Python and 
Pygame, but our sensory system is far 
from overloaded here. Don’t worry, as 
that will be covered in the next tutorial, 
adding animation and sound effects to 
our game to give it the spit and polish 
any self-respecting Space Invaders- 
inspired shooter demands... 


O Setting up dependencies 
If youre looking to get a better understanding of 
programming games with Python and Pygame, we strongly 
recommend you copy the Pivaders code in this tutorial into your 
own program. It’s great practice and gives you a chance to tweak 
elements of the game to suit you, be it a different ship image, 
changing the difficulty or the ways the alien waves behave. If you 
just want to play the game, that’s easily achieved too, though. 
Either way, the game’s only dependency is Pygame, which (if it 
isn’t already) can be installed from the terminal by typing: 
sudo apt-get install python-pygame 
O Downloading the project 
For Pivaders we've used Git, a brilliant form of version 
control used to safely store the game files and retain historical 
versions of your code. Git should already be installed on your Pi; if 
not, you can acquire it by typing: 
sudo apt-get install git 
As well as acting as caretaker for your code, Git enables you 
to clone copies of other people’s projects so you can work on 
them, or just use them. To clone Pivaders, go to your home 
folder in the terminal (cd ~), make a directory for the project 
(mkdir pivaders), enter the directory (cd pivaders) and type: 
git pull https://github.com/russb/8/pivaders.git 


import pygame, random 


BLACK = (2, 2, 2) 

BLUE = (0, @, 255) 
WHITE = (255, 255, 255) 
RED = (255, , Q) 
ALIEN_SIZE = (30, 40) 
ALIEN_SPACER = 20 
BARRIER_ROW = 10 
BARRIER_COLUMN = 4 


BULLET_SIZE = (5, 10) 
MISSILE_SIZE = (5, 5) 
BLOCK_SIZE = (10, 10) 


RES = (800, 600) 


class Player(pygame.sprite.Sprite): 

def __init__(self): 
pygame.sprite.Sprite.. init__(self) 
self.size = (60, 55) 
self.rect = self.image.get_rect() 
self.rect.x = (RES[0] / 2) - (self.size[0] / 
self.rect.y = 520 
self.travel = 7 
self.speed = 350 
self.time = pygame.time.get_ticks() 


def update(self): 
self.rect.x += GameState.vector * self.trave 
if self.rect.x < Q: 
self.rect.x = @ 
elif self.rect.x > RES[Q] - self.size[Q]: 
self.rect.x = RES[@] - self.size[Q] 


class Alien(pygame.sprite.Sprite): 

def __init__(self): 
pygame.sprite.Sprite.. init__(self) 
self.size = (ALIEN_SIZE) 
self.rect = self.image.get_rect() 
self.has_moved = [2, 2] 
self.vector = [1, 1] 
self.travel = [(ALIEN_SIZE[0] - 7), ALIEN_SP, 
self.speed = 700 
self.time = pygame.time.get_ticks() 


def update(self): 


ae 


Clean clode 
Having all the most 
regularly used 
global variables 
clearly labelled 
here makes our 
code later on easier 
to read. Also, if we 
want to change the 
size of something, 
we only need to do 
it here and it will 
work everywhere. 


2) 


1 


ACER] 


if GameState.alien_time - self.time > self.speed: 


if self.has_moved[@] < 12: 


self.rect.x += self.vector[0] * self.travel[Q] 


self.has_moved[0] +=1 
else: 
if not self.has_moved[1]: 


self.rect.y += self.vector[1] * self.travel[1] 


self.vector[Q] *= -1 
self.has_moved = [2, 2] 
self.speed -= 20 
if self.speed <= 100: 
self.speed = 100 
self.time = GameState.alien_time 


| class Ammo(pygame.sprite.Sprite): 


def __init__(self, color, (width, height)): 
pygame.sprite.Sprite.. init__(self) 
self.image = pygame.Surface(Lwidth, height]) 
self.image.fill(color) 
self.rect = self.image.get_rect() 
self.speed = 2 
self.vector = 2 


def update(self): 
self.rect.y += self.vector * self.speed 
if self.rect.y < @ or self.rect.y > RES[1]: 
self. killQ) 


class Block(pygame.sprite.Sprite): 
def __init__(self, color, (width, height)): 
pygame.sprite.Sprite.. init__(self) 
self.image = pygame.Surface([width, height]) 
self.image.fill(color) 
self.rect = self.image.get_rect() 


Rain bullets 
The Ammo class is 
short and sweet. 

We only need a few 
initialising attributes 
and the update 
method checks if it’s 
stillon the screen. If 
not, it’s destroyed. 


class GameState: 
pass 


class Game(object): 
def __init__(self): 

pygame.init() 
pygame.font.initQ 
self.clock = pygame.time.Clock() 
self.game_font = pygame.font.Font( 
‘data/Orbitracer.ttf’, 28) 
self.intro_font = pygame.font.Font( 
‘data/Orbitracer.ttf’, 72) 
self.screen = 
self.time = pygame.time.get_ticks() 
self.refresh_rate = 20 
self.rounds_won = 0 
self.level_up = 520 
self.score = 0 
self.lives = 2 
self.player_group = pygame.sprite.Group() 
self.alien_group = pygame.sprite.Group() 
self.bullet_group = pygame.sprite.Group() 
self.missile_group = pygame.sprite.Group() 
self.barrier_group = pygame.sprite.Group() 
self.all_sprite_list = pygame.sprite.Group() 
self.intro_screen = pygame.image.load( 
‘data/start_screen.jpg’).convert() 
self.background = pygame.image.load( 
‘data/Space-Background.jpg’).convert() 


Get 
the code: 


bit.ly/ 
11k5f2x 


pygame.display.set_mode([RES[@], RES[1]]) 


Groups This 
long list of groups 
we're creating are 
essentially sets.Each 
time we create one 
of these items, it’s 
added to the set so 
itcan be tested for 
collisions and drawn 
with ease. 


pygame.display.set_caption(‘Pivaders - ESC to exit’) 


pygame.mouse.set_visible(False) 
Player.image = pygame.image.load( 
‘data/ship.png’).convert() 
Player. image.set_colorkey(BLACK) 
Alien.image = pygame.image.load( 
‘data/Spaceship16.png’).convert() 
Alien.image.set_colorkey(WHITE) 
GameState.end_game = False 
GameState.start_screen = True 
GameState.vector = @ 
GameState.shoot_bullet = False 


def control(self): 
for event in pygame.event.get(): 
if event.type == pygame.QUIT: 
GameState.start_screen = False 
GameState.end_game = True 
if event.type == pygame.KEYDOWN \ 
and event.key == pygame.K_ESCAPE: 
if GameState.start_screen: 
GameState.start_screen = 
GameState.end_game = True 
self.kill_allQ 
else: 
GameState.start_screen = True 
self.keys = pygame.key.get_pressed() 
if self.keys[pygame.K_LEFT]: 
GameState.vector = -1 
elif self.keys[pygame.K_RIGHT]: 
GameState.vector = 1 
else: 
GameState.vector = @ 
if self.keys[pygame.K_SPACE]: 
if GameState.start_screen: 
GameState.start_screen = 
self.lives = 2 
self.score = 0 
self.make_player() 
self.make_defenses() 
self.alien_wave(2) 
else: 
GameState.shoot_bullet = True 


False 


False 


def splash_screen(self): 
while GameState.start_screen: 
self.kill_allQ 
self.screen.blit(self.intro_screen, [2, 2]) 
self.screen.blit(self.intro_font.render( 
“PIVADERS”, 1, WHITE), (265, 120)) 
self.screen.blit(self.game_font.render( 


QE 


Control taking 
care of keyboard 
input is the control 
method. It checks 
for key events and 
acts accordingly 
depending whether 
we’re on the start 
screen or playing 
the game. 


“PRESS SPACE TO PLAY”, 1, WHITE), (274, 191)) 
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0 Testing Pivaders 

With Pygame installed and the 
project cloned to your machine (you can 
also find the .zip on FileSilo — simply 
unpack it and copy it to your home 
directory to use it), you can take it for a 
quick test drive to make sure everything's 
set up properly. All you need to do is type 
python pivaders.py from within the 
pivaders directory in the terminal to get 
started. You can start the game with the 
space bar, shoot with the same button 
and simply use the left and right arrows 
on your keyboard to move your ship left 
and right. 


0 Creating your own clone 

Once you've racked up a good 
high score (anything over 2,000 points is 
respectable) and got to know our simple 
implementation, you'll get more from 
following along with and exploring the 
code and our brief explanations of what’s 
going on. For those who want to make 
their own project, create a new project 
folder and use either IDLE or Leafpad (or 
perhaps install Geany) to create and save 
a.py file of your own. 


O Global variables & tuples 
Once we've imported the 
modules we need for the project, 
there’s quite a long list of variables in 
block capitals. The capitals denote that 
these variables are constants (or global 
variables). These are important numbers 
that never change — they represent things 
referred to regularly in the code, like 
colours, block sizes and resolution. You'll 
also notice that colours and sizes hold 
multiple numbers in braces — these are 
tuples. You could use square brackets (to 
make them lists), but we use tuples here 
since they're immutable, which means 


you can't reassign individual items within 
them. Perfect for constants, which aren't 
designed to change anyway. 


O Classes — part 1 

A class is essentially a blueprint 
for an object you'd like to make. In the 
case of our player, it contains all the 
required info, from which you can make 
multiple copies (we create a player 
instance in the make_player() method 
halfway through the project). The great 
thing about the classes in Pivaders is 
that they inherit lots of capabilities and 
shortcuts from Pygame’s Sprite class, 
as denoted by the pygame.sprite.Sprite 
found within the braces of the first line 
of the class. You can read the docs to 
learn more about the Sprite class via 
www.pygame.org/docs/ref/sprite.html. 


O Classes — part 2 

In Pivader’s classes, besides 
creating the required attributes — these 
are simply variables in classes — for the 
object (be it a player, an alien, some 
ammo or a block), you'll also notice all 
the classes have an update() method 
apart from the Block class (a method is 
a function within a class). The update() 
method is called in every loop through 
the main game (we've called ours 
main_loop()) and simply asks the 
iteration of the class we've created to 
move. In the case of a bullet from the 
Ammo class, we're asking it to move 
down the screen. If it goes off either the 
top or bottom of the screen, we destroy 
it (Since we don’t need it any more). 


O Ammo 

What’s most interesting about 
classes, though, is that you can use one 
class to create lots of different things. 


PIUADERS 


PRESS SPACE TO PLAY 


We used widely available open sounee 
art and fonts to make the game 
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You could, for example, have a pet class. From that class you 
could create a cat (that meows) and a dog (that barks). They're 
different in many ways, but they’re both furry and have four 
legs, so can be created from the same parent class. We've 
done exactly that with our Ammo class, using it to create both 
the player bullets and the alien missiles. They’re different 
colours and they shoot in opposite directions, but they’re 
fundamentally one and the same. This saves us creating extra 
unnecessary code and ensures consistent behaviour between 
objects we create. 


O The game 

Our final class is called Game. This is where all the main 
functionality of the game itself comes in, but remember, so far 
this is still just a list of ingredients — nothing can actually happen 
until a ‘Game’ object is created (right at the bottom of the code). 
The Game class is where the central mass of the game resides, 
so we initialise Pygame, set the imagery for our protagonist 
and extraterrestrial antagonist and create some GameState 
attributes that we use to control key aspects of external classes, 
like changing the player’s vector (direction) and deciding if we 
need to return to the start screen, among other things. 


1 The main loop 

There are a lot of methods (class functions) in the Game 
class, and each is designed to control a particular aspect of 
either setting up the game or the gameplay itself. The actual logic 
that dictates what happens within any one round of the game is 
actually contained in the main_loop() method right at the bottom 
of the pivaders.py script and is the key to unlocking exactly what 
variables and functions you need for your game. Starting at 
the top of main_loop() and working line-by-line down to its last 
line, you can see exactly what’s being evaluated 20 times every 
second when you’e playing the game. 


1 Main loop key logic — part 1 

Firstly the game checks that the end_game attribute is 
false — if it’s true, the entire loop in main_loop() is skipped and 
we go straight to pygame.quit(), exiting the game. This flag is set 
to true only if the player closes the game window or presses the 
Esc key when on the start_screen. Assuming end_game and 
start_screen are false, the main loop can start proper, with the 
control() method, which checks to see if the location of the player 
needs to change. Next we attempt to make an enemy missile and 
we use the random module to limit the number of missiles that 
can be created. Next we call the update() method for each and 
every actor on the screen using a simple for loop. This makes 
sure everyone's up to date and moved before we check collisions 
in calc_collisions(). 


1 Main loop key logic — part 2 

Once collisions have been calculated, we need to see if 
the game is still meant to continue. We do so with is_dead() and 
defenses_breached() - if either of these methods returns true, 
we know we need to return to the start screen. On the other 
hand, we also need to check to see if we've killed all the aliens, 
from within win_round(). Assuming we're not dead, but the 
aliens are, we know we can call the next_round() method, which 
creates a fresh batch of aliens and increases their speed around 
the screen. Finally, we refresh the screen so everything that’s 
been moved, shot or killed can be updated or removed from the 
screen. Remember, the main loop happens 20 times a second — 
so the fact we don't call for the screen to update right at the end 
of the loop is of no consequence. 


Se ga 


Dead or alive Probably two of the most 
important questions are answered here — is 


ta class is essentially a blueprint celicedeou oad 


pygame.display.flip() a 
self.control() 


Refreshing 
def make_player(self): the screen You 
self.player = Player() need to carefully 
self.player_group.add(self.player) consider the way in 
self.all_sprite_list.add(self.player) which you update 

the screen. Blitting 
def refresh_screen(self): the background 
self.all_sprite_list.draw(self.screen) between actor 
self.refresh_scores() movements is vital 
pygame.display.flip() for clean animation. 


self.screen.blit(self.background, [2, 2]) | 
self.clock.tick(self.refresh_rate) 


def refresh_scores(self): 
self.screen.blit(self.game_font.render( 
“SCORE “ + str(self.score), 1, WHITE), (10, 8)) 
self.screen.blit(self.game_font.render( 
“LIVES “ + str(self.lives + 1), 1, RED), (355, 575)) 


def alien_wave(self, speed): 
for column in range(BARRIER_COLUMN): 
for row in range(BARRIER_ROW): 

alien = Alien() 
alien.rect.y = 65 + (column * ( 
ALIEN_SIZE[1] + ALIEN_SPACER)) 
alien.rect.x = ALIEN_SPACER + ( 
row * (ALIEN_SIZE[0] + ALIEN_SPACER)) 
self.alien_group.add(alien) 
self.all_sprite_list.add(alien) 
alien.speed -= speed 


def make_bullet(self): 
if GameState.game_time - self.player.time > self.player.speed: 
bullet = Ammo(BLUE, BULLET_SIZE) 
bullet.vector = -1 
bullet.speed = 26 


bullet.rect.x = self.player.rect.x + 28 ee 


bullet.rect.y = self.player.rect.y 


Pe) 
self.bullet_group.add(bullet) Guns’n’ammo 
self.all_sprite_list.add(bullet) Bullets and missiles 
self.player.time = GameState.game_time use the same parent 

GameState.shoot_bullet = False class. We change a 
few key attributes 
def make_missile(self): originally initialised 
if len(self.alien_group): to create the 
shoot = random.random() behaviour we need; 
if shoot <= Q.05: eg the vector for each 
shooter = random.choice([ is opposite. 


alien for alien in self.alien_group]) ( 
missile = Ammo(RED, MISSILE_SIZE) 


missile.vector = 1 

missile.rect.x = shooter.rect.x + 15 
missile.rect.y = shooter.rect.y + 40 
missile.speed = 10 
self.missile_group.add(missile) 
self.all_sprite_list.add(missile) 


def make_barrier(self, columns, rows, spacer): 
for column in range(columns): 
for row in range(rows): 
barrier = Block(WHITE, (BLOCK_SIZE)) 
barrier.rect.x = 55 + (200 * spacer) + (row * 10) 
barrier.rect.y = 452 + (column * 12) 
self.barrier_group.add(barrier) 
self.all_sprite_list.add(barrier) 


def make_defenses(self): 
for spacing, spacing in enumerate(xrange(4)): 
self.make_barrier(3, 9, spacing) 


def kill_all(self): 
for items in [self.bullet_group, self.player_group, 
self.alien_group, self.missile_group, self.barrier_group]: 
for i in items: 
i.killQd 


def is_dead(self): 
if self.lives < @: (e7=\4 

self.screen.blit(self.game_font.render( bd atzXoreye (= 
“The war is lost! You scored: “ + str( bit.ly/ 
self.score), 1, RED), (250, 15)) : 
self.rounds_won = @ 
self.refresh_screen() 
pygame.time.delay(3000) 
return True 


11k5f2x 


def win_round(self): 
if len(self.alien_group) < 1: 
self.rounds_won += 1 
self.screen.blit(self.game_font.render( 
“You won round “ + str(self.rounds_won) + 
“but the battle rages on”, 1, RED), (200, 15)) 
self.refresh_screen() 
pygame.time.delay(3020) 
return True 


def defenses_breached(self): 
for alien in self.alien_group: 
if alien.rect.y > 410: 

self.screen.blit(self.game_font.render( 
“The aliens have breached Earth defenses!”, 
1, RED), (180, 15)) 
self.refresh_screen() 
pygame.time.delay(3020) 
return True 


def calc_collisions(self): 

pygame.sprite.groupcollide( 

self.missile_group, self.barrier_group, True, True) 

pygame.sprite.groupcollide( 

self.bullet_group, self.barrier_group, True, True) 

if pygame.sprite.groupcollide( 

self.bullet_group, self.alien_group, True, True): 
self.score += 10 

if pygame.sprite.groupcollide( 

self.player_group, self.missile_group, False, True): 
self.lives -= 1 


def next_round(self): QE 


for actor in [self.missile_group, Main loop This 


self.barrier_group, self.bullet_group]: isthe business ond 
for i in actor: 


Para of our application. 
aka This loop executes 
20 times asecond. It 
needs to be logical 
and easy for another 


def main_loop(self): coder to understand. 
while not GameState.end_game: a 
while not GameState.start_screen: 
GameState.game_time = pygame.time.get_ticks() 
GameState.alien_time = pygame.time.get_ticks() 
self.control() 
self.make_missile() 
for actor in [self.player_group, self.bullet_group, 
self.alien_group, self.missile_group]: 
for i in actor: 
i.update() 
if GameState.shoot_bullet: 
self.make_bullet() 
self.calc_collisions() 
if self.is_dead() or self.defenses_breached(): 
GameState.start_screen = True 
if self.win_round(): 
self.next_round() 
self.refresh_screen() 


self. splash_screen() Le 


pygame.quit() Start the gaME The very last thing 


we dois create a Game object and call the 
main loop. Besides our constants, this is 
the only code that sits outside aclass. 


self.alien_wave(self.level_up) 
self.make_defenses() 
self.level_up += 50 


if __name__ == ‘__main__’: 
pv = Game() 
pv.main_loop() 
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SCORE SO 


ee ee 


Part two: Add animation and 


sound to Pivaders 


After writing a Space Invaders clone in just 300 lines of Python, 
now we expand It to include animation and sound 


Resources 


Raspbian: www.raspberrypi.org 


/downloads 
Python: www.python.org/doc 
Pygame: www.pygame.org/docs 


Art assets: opengameart.org 


We had great fun creating our basic 
Space Invaders clone, Pivaders, 
for the previous tutorial. One of the 
key challenges with the project was 
keeping it to a manageable size — just 
300 lines of Python. Without the use 
of Pygame’s strong set of features, 
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that goal would likely have been overshot at least twofold. 
Pygame’s ability to group, manage and detect collisions 
thanks to the Sprite class really made a great difference 
to our project, not just in terms of length but in simplicity. 
f you missed the first part of the project, you can find the 
v0.1 code listing on GitHub via git.io/cBVTBg, while you can 
ind version v0.2, including all the images, music and sound 
effects we used, over at git.io/8QsK-w. 

Even working within the clearly defined framework 
Pygame offers, there are still a thousand ways we could 
have approached adding animation and sound. We could 
have created any one of a dozen classes to create and 
manage containers of individual images, or read in a sprite 
sheet (a single image full of smaller, separate images) 
which we could then draw (or blit) to the screen. For the 
sake of simplicity and performance, we integrated a few 
animation methods into our Game class and opted to use a 
sprite sheet. Not only does it make it very easy to draw to the 
screen, but it also keeps the asset count under control and 
keeps performance levels up, which is especially important 
for the Raspberry Pi. 


0 Setting up dependencies 

As we recommended with 
the last tutorial, you'll get much more 
from the exercise if you download 
the code (git.io/8QsK-w) and use it 
for reference as you create your own 
animations and sound for your Pygame 
projects. Regardless of whether you 
just want to simply preview and play or 
walk-through the code to get a better 
understanding of basic game creation, 
you're still going to need to satisfy 
some basic dependencies. The two key 
requirements here are Pygame and Git, 
both of which are installed by default 
on up-to-date Raspbian installations. 
If you’re unsure if you have them, 
though, type the following at the 
command line: 

sudo apt-get install python- 
pygame git 


Pivaders.py listing 


class Game(object): 
def __init__(self): 

pygame. init) 
pygame.font.init() 
self.clock = pygame.time.Clock() 
self.game_font = pygame.font.Font( 
‘data/Orbitracer.ttf’, 28) 
self.intro_font = pygame.font.Font( 
‘data/Orbitracer.ttf’, 72) 
self.screen = pygame.display.set_mode([RES[@], RES[1]]) 


self.time = pygame.time.get_ticks() ——— 


self.refresh_rate = 20; self.rounds_won = @ 


self.level_up = 50; self.score = 0 ship_sheet 
self.lives = 2 ' We set the player 

se f.player_group = pygame.sprite.Group() image to be equal to 
self.alien_group = pygame. sprite.Group() one small segment 
self.bullet_group = pygame.sprite.Group() of the sprite sheet by 


self.missile_group = pygame.sprite.Group() 


: : using the ‘ani_pos’ 
self.barrier_group = pygame.sprite.Group() 


variable. Change the 


self.all_sprite_list = pygame.sprite.Group() variable to change 
self.intro_screen = pygame.image.load( the picture 
‘data/graphics/start_screen.jpg’).convert() 

SEE 


self.background = pygame.image. load( 
‘data/graphics/Space-Background.jpg’).convert() 
pygame.display.set_caption(‘Pivaders - ESC to exit’) 
pygame.mouse.set_visible(False) 
Alien.image = pygame.image.load( 
‘data/graphics/Spaceship16.png’).convert() 
Alien.image.set_colorkey(WHITE) 
self.ani_pos = 5 
self.ship_sheet = pygame.image.load( 
‘data/graphics/ship_sheet_final.png’).convert_alpha() 
Player.image = self.ship_sheet.subsurface( 
self.ani_pos*64, @, 64, 61) 
self.animate_right = False 
self.animate_left = False 
self.explosion_sheet = pygame.image.load( 
‘data/graphics/explosion_newl.png’).convert_alpha() 
self.explosion_image = self.explosion_sheet.subsurface(2, 2, «4 
79, 96) 
self.alien_explosion_sheet = pygame.image.load( 
‘data/graphics/alien_explosion.png’) 
self.alien_explode_graphics = self.alien_explosion_sheet. + 
subsurface(@, 2, 94, 96) 
self.explode = False 
self.explode_pos = 2; self.alien_explode = False 
self.alien_explode_pos = @ 
pygame.mixer.music.load(‘data/sound/10_Arpanauts.ogg’) 
pygame.mixer.music.play(-1) 
pygame.mixer.music.set_volume(2.7) 
self.bullet_fx = pygame.mixer.Sound( 
‘data/sound/medetix__pc-bitcrushed-lazer-beam.ogg’) 
self.explosion_fx = pygame.mixer.Sound( 
‘data/sound/timgormly__8-bit-explosion.ogg’) 
self.explosion_fx.set_volume(@.5) 
self.explodey_alien = [] 
GameState.end_game = False 
GameState.start_screen = True 
GameState.vector = 2 
GameState.shoot_bullet = False 


oO 


de 


“ty 


control(self): 
for event in pygame.event.get(): 
if event.type == pygame.QUIT: 
GameState.start_screen = False 
GameState.end_game = True 
if event.type == pygame.KEYDOWN \ 
and event.key == pygame.K_ESCAPE: 
if GameState.start_screen: 
GameState.start_screen = False 


ooo 


GameState.end_game = True 

self.kill_allQ 

else: 

GameState.start_screen = True 
self.keys = pygame.key.get_pressed() 
if self.keys[pygame.K_LEFT]: 

GameState.vector = -1 
self.animate_left = True 
self.animate_right = False 
elif self.keys[pygame.K_RIGHT]: 
GameState.vector = 1 


Set flags We’ve 
added ‘animate_left’ 
and ‘animate_right’ 
Boolean flags to 

the control method. 
When they’re true, 
the actual animation 
code is called viaa 
separate method 


def 


def 


def 


def 


def 


Get 
the code: 
bit.ly/ 
1xPvY1F 


self.animate_right = True 

self.animate_left = False 
else: 

GameState.vector = 2 

self.animate_right = False 

self.animate_left = False 


if self.keys[pygame.K_SPACE]: 
if GameState.start_screen: 
GameState.start_screen = False 
self.lives = 2 
self.score = 0 


self.make_player() 

self.make_defenses() Ay 

self.alien_wave(2) loaded the sound 
else: effect we want when 


GameState.shoot_bullet = True 


self.bullet_fx.play() Weeloch vee 


just need to callit 
when we press the 
space bar 

—— SSS), 


animate_player(self): 
if self.animate_right: 
if self.ani_pos < 10: 
Player.image = self.ship_sheet.subsurface( 
self.ani_pos*64, 2, 64, 61) 
self.ani_pos += 1 
else: 
if self.ani_pos > 5: 
self.ani_pos -= 1 
Player.image = self.ship_sheet.subsurface( 
self.ani_pos*64, 2, 64, 61) 


if self.animate_left: 
if self.ani_pos > 2: 
self.ani_pos -= 1 
Player.image = self.ship_sheet.subsurface( 
self.ani_pos*64, 2, 64, 61) 
else: 
if self.ani_pos < 5: 
Player.image = self.ship_sheet.subsurface( 
self.ani_pos*64, 2, 64, 61) 
self.ani_pos += 1 


player_explosion(self): 
if self.explode: 
if self.explode_pos < 8: 
self.explosion_image = self.explosion_sheet. «1 


subsurface(®, self.explode_pos*96, 79, 96) 


self.explode_pos += 1 
self.screen.blit(self.explosion_image, [self.player. + 


rect.x -10, self.player.rect.y - 32]) 


else: 
self.explode = False 
self.explode_pos = 2 


alien_explosion(self): 
if self.alien_explode: 
if self.alien_explode_pos < 9: 
self.alien_explode_graphics = self.alien_explosion_ « 


sheet.subsurface(®, self.alien_explode_pos*96, 94, 96) 


self.alien_explode_pos += 1 
self.screen.blit(self.alien_explode_graphics, + 


Lint(self. explodey_alien[@]) - 5@ , int(self.explodey_alien[1]) - 62]) 


else: 
self.alien_explode = False 
self.alien_explode_pos = @ 
self.explodey_alien = [] 


splash_screen(self): 

while GameState.start_screen: 
self.kill_allQ 
self.screen.blit(self.intro_screen, [2, 2]) 
self.screen.blit(self.intro_font.render( 
“PIVADERS”, 1, WHITE), (265, 120)) 
self.screen.blit(self.game_font.render( 
“PRESS SPACE TO PLAY”, 1, WHITE), (274, 191)) 
pygame.display.flipQ 
self.control() 
self.clock.tick(self.refresh_rate / 2) 


make_player(self): 
self.player = Player() 
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0 Downloading pivaders 
Git is a superb version control 

solution that helps programmers safely 
store their code and associated files. 
Not only does it help you retain a full 
history of changes, it means you can 
‘clone’ entire projects to use and work 
on from places like github.com. To clone 
the version of the project we created for 
this tutorial, go to your home folder from 
the commandline (cd ~) and type: 

git pull https://github.com/ 
russb78/pivaders.git 

This will create a folder called 
pivaders — go inside (cd pivaders) and 
take a look around. 


O Navigating the project 

The project is laid out quite 
simply across a few subfolders. Within 
pivaders sits a licence, readme and a 
second pivaders folder. This contains 
the main game file, pivaders.py, which 
launches the application. Within the 
data folder you'll find subfolders for both 
graphics and sound assets, as well as the 
font we've used for the title screen and 
scores. To take pivaders for a test-drive, 
simply enter the pivaders subdirectory 
(cd pivaders/pivaders) and type: 

python pivaders.py 

Use the arrow keys to steer left and right 
and the space bar to shoot. You can quit 
to the main screen with the Esc key and 
press it again to exit the game completely. 


0 Animation & sound 
Compared with the game from 
last month's tutorial, you'll see it’s now 
a much more dynamic project. The 
protagonist ship now leans into the turns 
as you change direction and corrects 
itself when you either press the opposite 
direction or lift your finger off the button. 
When you shoot an alien ship, it explodes 


Mele 


etetie © latest cownde 


— SO White Noise Snare.wav 


PC Quick Lazer.wav 


SOPRR wedetx 


with several frames of animation and 
should you take fire, a smaller explosion 
occurs on your ship. Music, lasers and 
explosion sound effects also accompany 
the animations as they happen. 


9) Finding images to animate 

Before we can program anything, 
it’s wise to have assets set up in a way we 
can use them. As mentioned, we've opted 
to use sprite sheets; these can be found 
online or created with GIMP with a little 
practice. Essentially they’re a mosaic 
made up of individual ‘frames’ of equally 
sized and spaced images representing 
each frame. Find ready-made examples 
at opengameart.org, as used here. 


@) Tweaking assets 

While many of the assets on 
sites like opengameart.org can be used 
as is, you may want to import them into 
an image-editing application like GIMP 
to configure them to suit your needs — as 
we did with our ship sheet asset to help 
us keep the code simple. We started with 
the central ship sprite and centred it intoa 
new window. We set the size and width of 
the frame and then copy-pasted the other 
frames either side of it. We ended up with 
11 frames of exactly the same size and 
width in a single document. Pixel-perfect 
precision on size and width is key, so we 
can just multiply it to find the next frame. 


O07 Loading the sprite sheet 


Since we're inheriting from the 
Sprite class to create our Player class, we 
can easily alter how the player looks on 
screen by changing Player.image. First, 
we need to load our ship sprite sheet with 
pygame.image.load(). Since we made our 
sheet with a transparent background, 
we can append .convert_alpha() to the 


crentetia e meat weed tags 


Beam Bit _ Crusher 


Daft Derezzed 


Lazer Percussion 
Punk 


Above The Freesound site is a good place to find free and open sound effects for projects 
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end of the line so the ship frames render correctly (without any 
background). We then use subsurface to set the initial Player. 
image to the middle ship sprite on the sheet. This is set by self. 
ani_pos, which has an initial value of 5. Changing this value will 
alter the ship image drawn to the screen: ‘0’ would draw it leaning 
fully left, ‘11’ fully to the right. 


0 Animation flags 

Down the list in the initialising code for the Game class, 
we set two flags for player animation: self.animate_left and 
self.animate_right. In the Control method of our Game class, 
we use these to ‘flag’ when we want animations to work using 
Boolean values. It allows us to ‘automatically’ animate the 
player sprite back to its resting state (otherwise the ship will 
continue to look as if it’s flying left when it has stopped). 


'@) The animation method 

These flags pop up again in the core animation code for 
the player: animate_player() within the Game class. Here we 
use nested if statements to control the animation and physically 
set the player image accordingly. Essentially it states that if the 
animate_right flag is True and if the current animation position 
is different to what we want, we incrementally increase the 
ani_pos variable and set the player's image accordingly. The Else 
statement then animates the ship sprite back to its resting state 
and the same logic is then applied in the opposite direction. 


1 Animating explosions 

The player_explosion() and alien_explosion() methods 
that come after the player animation block in the Game class are 
similar but simpler executions of essentially the same thing. As 
we only need to run through the same predefined set of frames 
(this time vertically), we only need to see if the self.explode and 
self.alien_explode flags are True before we increment the 
variables that change the image displayed. As the sprite sheet is 
vertical, the variables alien_explode_pos and explosion_image 
are set to a different part of subsurface than before. 


1 Adding music to your project 
Pygame makes it easy to add a musical score to a project. 
Just obtain a suitable piece of music in your preferred format (we 
found ours via freemusicarchive.org) and load it using the Mixer 
Pygame class. As it’s already been initialised via pygame.init(), 
we can go ahead and load the music with this code: 
pygame.mixer.music. load(‘data/sound/10_Arpanauts.ogg’) 
pygame.mixer.music.play(-1) 
pygame.mixer.music.set_volume(Q.7) 
The music.play(-1) requests that the music should start with the 
app and continue to loop until it quits. If we replaced -1 with 5, the 
music would loop five times before ending. Learn more about the 
Mixer class via www.pygame.org/docs/ref/mixer.html. 


1 Using sound effects 
Loading and using sounds is similar to how we do so for 
images in Pygame. First we load the sound effect using a simple 
assignment. For the laser beam, the initialisation looks like this: 
self.bullet_fx = pygame.mixer.Sound( 
‘data/sound/medetix__pc-bitcrushed-lazer-beam.ogg’) 
Then we simply trigger the sound effect at the appropriate time. 
In the case of the laser, we want it to play whenever we press the 
space bar to shoot, so we place it in the Game class's Control 
method, straight after we raise the shoot_bullet flag. 
If youre struggling to find free and open sound effects, we 
recommend www.freesound.org. 


self.player_group.add(self. player) 
self.all_sprite_list.add(self. player) 


def refresh_screen(self): 
self.all_sprite_list.draw(self.screen) 
self.animate_player() 
self.player_explosion() 
self.alien_explosion() 
self.refresh_scores() 
pygame.display.flipQ 
self.screen.blit(self.background, [2, 2]) 
self.clock.tick(self.refresh_rate) 


def refresh_scores(self): 
self.screen.blit(self.game_font.render( 
“SCORE “ + str(self.score), 1, WHITE), (10, 8)) 
self.screen.blit(self.game_font.render( 
“LIVES “ + str(self.lives + 1), 1, RED), (355, 575)) 


def alien_wave(self, speed): 
for column in range(BARRIER_COLUMN): 
for row in range(BARRIER_ROW): 

alien = AlienQ 
alien.rect.y = 65 + (column * (¢ 
ALIEN_SIZE[1] + ALIEN_SPACER)) 
alien.rect.x = ALIEN_SPACER + ( 
row * (ALIEN_SIZE[@] + ALIEN_SPACER)) 
self.alien_group.add(alien) 
self.all_sprite_list.add(alien) 
alien.speed -= speed 


def make_bullet(self): 


if GameState.game_time - self.player.time > self.player.speed: 


bullet = Ammo(BLUE, BULLET_SIZE) 

bullet.vector = -1 

bullet.speed = 26 

bullet.rect.x = self.player.rect.x + 28 

bullet.rect.y = self.player.rect.y 

self.bullet_group.add(bullet) 

self.all_sprite_list.add(bullet) 

self.player.time = GameState.game_time 
GameState.shoot_bullet = False 


def make_missile(self): 
if len(self.alien_group): 

shoot = random.random() 

if shoot <= 0.05: 
shooter = random.choice([ 
alien for alien in self.alien_group]) 
missile = Ammo(RED, MISSILE_SIZE) 
missile.vector = 1 
missile.rect.x = shooter.rect.x + 15 
missile.rect.y = shooter.rect.y + 42 
missile.speed = 10 
self.missile_group.add(missile) 
self.all_sprite_list.add(missile) 


def make_barrier(self, columns, rows, spacer): 
for column in range(columns): 
for row in range(rows): 

barrier = Block(WHITE, (BLOCK_SIZE)) 
barrier.rect.x = 55 + (200 * spacer) + (row * 10) 
barrier.rect.y = 450 + (column * 12) 
self.barrier_group.add(barrier) 
self.all_sprite_list.add(barrier) 


def make_defenses(self): 
for spacing, spacing in enumerate(xrange(4)): 
self.make_barrier(3, 9, spacing) 


def kill_allGelf): 
for items in [self.bullet_group, self.player_group, 
self.alien_group, self.missile_group, self.barrier_group]: 
for i in items: 
i-killO 


def is_dead(self): 
if self.lives < @: 

self.screen.blit(self.game_font.render( 
“The war is lost! You scored: “ + str( 
self.score), 1, RED), (250, 15)) 
self.rounds_won = 2 
self.refresh_screen() 
self.level_up = 50 


self.explode = False 


self.alien_explode = False Get 
pygame.time.delay(3002) . 
return True the code: 
bit.ly/ 
def defenses_breached(self): TxPVY1F 


for alien in self.alien_group: 
if alien.rect.y > 410: 

self.screen.blit(self.game_font.render( 
“The aliens have breached Earth defenses!”, 
1, RED), (18, 15)) 
self.refresh_screen() 
self.level_up = 50 
self.explode = False 
self.alien_explode = False 
pygame.time.delay(3002) 
return True 


def win_round(self): 
if len(self.alien_group) < 1: 
self.rounds_won += 1 
self.screen.blit(self.game_font.render( 
“You won round “ + str(self.rounds_won) + 
“but the battle rages on”, 1, RED), (200, 15)) 
self.refresh_screen() 
pygame.time.delay(3002) 
return True 


def next_round(self): 
self.explode = False 
self.alien_explode = False 
for actor in [self.missile_group, 
self.barrier_group, self.bullet_group]: 
for i in actor: 
i.killO 
self.alien_wave(self.level_up) 
self.make_defenses() 
self.level_up += 50 


def calc_collisions(self): 
pygame. sprite.groupcollide( 
self.missile_group, self.barrier_group, True, True) 
pygame. sprite.groupcollide( 
self.bullet_group, self.barrier_group, True, True) 


for z in pygame.sprite.groupcollide( 
self.bullet_group, self.alien_group, True, True): 
self.alien_explode = True 
self.explodey_alien.append(z.rect.x) 
self.explodey_alien.append(z.rect.y) 
self.score += 10 
self.explosion_fx.playQ) 


if pygame.sprite.groupcollide( 

self.player_group, self.missile_group, False, True): 
self.lives -= 1 
self.explode = True 
self.explosion_fx.playQ) 


def main_loop(self): 
while not GameState.end_game: 
while not GameState.start_screen: 
GameState.game_time = pygame.time.get_ticks() 
GameState.alien_time = pygame.time.get_ticks() 
self.control() 
self.make_missile() 
self.calc_collisions() 
self.refresh_screen() 
if self.is_dead() or self.defenses_breached(): 
GameState.start_screen = True 
for actor in [self.player_group, self.bullet_group, 
self.alien_group, self.missile_group]: 
for i in actor: 
i.update() 
if GameState.shoot_bullet: 
self.make_bullet() 
if self.win_round(): 
self.next_round() 
self.splash_screen() 
pygame.quit() 


if _.name__ == ‘__main__’: 


pv = Game() 
pv.main_loop(Q) 
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Make a visual novel 
game with Python 


Bridge the gap between books and videogames by creating an 
interactive novel or choose-your-own-adventure with Python 


and Pygame 


pygame window 


Here's scene two! 


m Change scenes to add more depth to the story, and allow the game to have decisions and routes 


Resources 
Python 2: 


www.python.org/ 


Pygame: 


pygame.org/download.shtml 
IDLE Python IDE 
Game assets 
Code from FileSilo (optional) 
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Most people look for a compelling story in 
modern videogames, and those that don’t 
have one are appearing less and less. A great 
way to tell a pure story is through the genre 
of visual novels, and you can make one fairly 
simply in Python. These interactive novels are 
an extremely popular form of entertainment in 
Japan, and usually work by having the player 
click through a story and make decisions as they 
go along in order to experience different plot 
points and endings. 


In Python, this is a relatively simple project 
to create, but with the addition of the Pygame 
module we can make it easier still, and even 
more expandable for the future. Pygame adds 
better support for positioning the images and 
text, creating display windows and using mouse 
and keyboard inputs, thereby simplifying the 
coding process. 

We'll be coding this in standard Python 2, so 
make sure to runit in IDLE 2 and not IDLE 3 while 
you are writing, testing and coding. 


0 Get Pygame dependencies 

The best way to install Pygame for your 
system is to compile it. To do this you need to 
first install the right dependencies. Open up 
the terminal and install the following packages, 
which in Ubuntu looks like: 


$ sudo apt-get install mercurial 
python-dev python-numpy libav-tools 
libsdl-imagel.2-dev libsdl-mixer1.2- 
dev libsdl-ttf2.0-dev libsmpeg- 

dev libsdl1.2-dev libportmidi-dev 
libswscale-dev libavformat-dev 
libavcodec-dev 


0 Get the Pygame code 

Next we need to download the code 
for Pygame direct from the source. Still in the 
terminal, you can do this by typing in: 


$ hg clone https://bitbucket.org/pygame/ 
pygame 


Which will download it to the folder ‘pygame’. 
Move to that using CD pygame in the terminal so 
we can continue building it. 


fe fee Mew Seeeh beet Me 
requesting all changes 

adding chasgesets 

adding manifests 

adding file changes 


robr@ubuntu: ~ 


Fle Edit View Search Terminal Help 


frobz@ubuntu:-$ sudo apt-get install mercurtal python-dev python-numpy Libav-tools Libsdl-tmagel.2-dev Libsdl-r 


v Libsdl1.2-dev Libportmidi- dev Libswscale-dev Libavformat dev Libavcodec dev 
[sudo] password for robz: 

Reading package lists... Done 

Building dependency tree 

Reading state information... Done 

python-dev is already the newest verston. 

python-numpy 1s already the newest verston. 

python-numpy set to manually installed. 

Uibav-tools ts already the newest version. 

libav-tools set to manually installed, 


The following packages were automatically tostalled and are no longer required: 


linux - headers. 3.13.0-40 Linux. headers -3.13.6-46-genertc 
Unux-headers-3.13.0-45 Uinux-headers-3.13.0-45-generic 
Unux-tmage-3.13.0-40-generic Linux-image-3.13.0-45-generic 
Linux-tmage-extra-3.13.0-40-genertc Linux-image-extra-3.13.0-45-generic 
screen 

Use ‘apt-get autoremove'’ to remove then. 

The following extra packages will be installed: 
Ubasound2-dev Libavahi-client-dev Libavaht-common-dev Libavutil-dev 
libcaca-dev Uibdbus-i-dev Libflac-dev Libjbig-dev Libjpeg-dev 
Libjpeg-turbo8-dev Ulbjpeg8-dev Liblzma-dev Ulbmad®-dev Libmiknod?-dev 
Uibogg-dev Libpngi2-dev Libpulse-dev libslang2-dev Libttiffs-dev Libtiffxxs 
Ubvorbts-dev Libwebp-dev Libwebpdemuxi mercurtal-common 

Suggested packages: 
Libasound?-doc Libde1394-22-dev Libgsmi-dev Librawi394-dev 
Libschroedinger-dev Libspeex-dev Libtheora-dev LUiblzma-doc qct vin emacs 
kdiff3 kdiff3-qt kompare meld tkcvs mgdtff python-mysqldb python-pygnments 

The following NEW packages will be installed 
libasound2-dev libavahi-client-dev Libavaht-common-dev Libavcodec-dev 
libavformat-dev Libavutil-dev Libcaca-dev Libdbus-i-dev Libflac-dev 
Libjbig-dev Ltbjpeg-dev Utibjpeg-turbo&-dev Libjpeg8-dev Liblzna-dev 
ltbmad6-dev libmikmod2-dev libogg-dev Libpngi2-dev Libportmidit-dev 
\WUbpulse-dev Libsdl-tmagei.2-dev libsdl-mixeri.2-dev Libsdl-ttf2z.0-dev 
libsdl1.2-dev libslang2-dev Libsmpeg-dev Libswscale-dev Libtiffs-dev 


LibtiffxxS Libvorbis-dev Libwebp-dev Libwebpdemuxl mercurtal 


mercurtal-common 


6 to upgrade, 34 to newly install, © to remove and 49 not to upgrade. 


ie i -) 


03 Build the Pygame module 


To install it, we need to do it in two 
steps. First we need to prepare the code to 
install using the terminal with: 


$ python setup.py build 


Once that’s finished you can then actually install 
it with: 


$ sudo python setup.py install 
This won't take too long. 


robr@ubuntu: — pygame 


added 3413 changesets with 14839 changes to 1790 files (+13 heeds 


updating te branch default 


673 files updated, 6 files nerged, 6 files removed, @ files unresolved 


robr@vbuntw:-$ cé pygene/ 
robz@ubunty:-/pygenesS pytion setup.py dutid 


WARNING, No “Setup” File Exists, Running “config.py” 
Using UNIX configuration 


Hunting dependenctes 
sh: i: freetype-conftg: set found 
th: t: freetype-config: set found 
freetype config: act found 
“freetype config” fatledt 
found 1.2.15 
found 
found 
Pound 
found 6.4.5 
found 
found 
found 
PORTMIOI: found 
PORTTIME: found 
AWFORRAT: found 
SWSCALE found 
FREETYPE: sot found 


Warniog, seme of the pygane dependenctes were not found. Pygane can still 
compile and install, but games that depend om these mtasing dependencies 


will sot ren. Would you like te continue the configuration? [fy 


L > 8 3 


ja}cy 


0 Install in other ways 

lf the above doesn’t work (or is a bit 
daunting) you can check the website for binary 
and executable files that will work on other 
operating systems and Linux distros. Head to 
http://pygame.org/download.shtml to get the 
files you need for your specific system, including 
Windows and OS X. The rest of the tutorial will 
work in any OS. 


@) Get the visual novel files 

We've uploaded the code to FileSilo, 
and here we're going to walk you through what 
we've done to make it work. Download the files 
for the visual novel and unzip them. The two 
files we care about for the moment are the 
visualnovel.py and script.py python files — this 
is where all the important code is. 


@) Understand the script file 

For the moment the script file is small 
and literally just holds the script for the game. 
It's made up of events for the visual novel to 
move between, line by line, by splitting it up into 
scenes. This includes the location of each line, the 
character, the actual line itself and information on 
how the game flows. These are matrices with the 
information in, and are completely customisable. 


a 
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0 How the script relates 

In our game, the code pulls in 
elements from the script file as it goes. We'll 
explain how that works later, but this also 
allows us to implement decisions later on to 
change which direction the game might take 
youin. 


time, script 


import pygame, 
pygame.init () 


0 Starting the main game 

We don’t need many modules for the 
current state of the visual novel. Here we've 
imported the new Pygame module, our script 
as a module and the time module for aesthetic 
reasons — we're going to have the code pause in 
bits rather than just instantly change scenes to 
the next line. We also initialise Pygame with a 
simple pygame.init() 


0 Add variables and assets 

We add a mixture of information we 
need to run the novel. We define the size of the 
display screen to use (1000 pixels wide and 563 
high), along with some RGB colours for the code 
to use. We're also telling Pygame what font to 
use and how large for certain sections and also 
loading images for the game. 


1 Start the game 

Create a display for the game. Pygame 
works by constantly updating the display with 
new information. To show how this works, the 
menu function adds elements to the display 
(which we've titled screen), such as filling it 
with colour, adding shapes and using blit to add 
images or in this case text. Once you've created 
a buffer of changes to the screen, you update it 
with the flip() function. 


1 See the mouse 

As we've created the button as a 
rectangle and now an image on the menu, we 
need to recognise when the mouse is hovering 
over it to know when the button is clicked. First 


we have to use event.get() to see the mouse 
in general, then we look for the position with 
get_pos(). After that, we wait for it to click, see 
where it clicked (using the co-ordinates of the 
rectangle) and make a decision after that. 


© start_game(): 


game_acripr, incation, character 


1 Start the story 

Our start_game function is called 
when the mouse clicks the right position and 
we prepare the game, getting the characters, 
locations and progression through the game 
script. The rest of this function uses this info to 
pull in data from the script to make the game 
flow properly. 


13 First screen 
The first screen is handled differently, 


and acts to get every element up on the 
interface before we continue — it makes the 
code take a little less time to process as we 


sa code pulls in elements from 
the script file as it goes, allowing us to 
implement decisions later on 


elit turn > O and click_state[0] == 1: 
line start = 0 
f i in range (4): 
i= line start == 0 and line[0] != '0O': 
print line[0] 


screen.blit(l 


time.sleep (i) 


line start == 1 and 
screen.blit(character[line[i]], 


time.sleep (1) 


ocation[line[0]], [0, 0]) 


line[{i] != '0' 


line start == 2: 


pygame.draw.rect (screen, 


(grey), 


elit line start == 3: 
screen.blit (gqame_font.render(line[2], 1, 


turn += 1 
line[3] ! 


game_script = 


<i 


line [3] 


time.sleep(0.5) 


game_state = 
clicked = 0 


line start += 1 


line [4] 


pygame.display.flip() 
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pygame.Rect (130, 


[377, 113]) 


423, 740, 120)) 


white), (135, 430)) 


begin. The getattr allows us to use the string/ 
integer associated with our place in the story 
and call upon the relevant scene function from 
the script file. We then use an if statement 
with an iterative function to successively add 
screen element to give the illusion that it’s 
building up the first screen. We finish it by 
advancing the progression value. 


deft game(): 
global game_running 
while game_running == 
menu_screen () 


True: 
game () 


1 Add variables and assets 

Similarly to the way that our original 
startup code works, our next if statement and 
iteration checks to see what is different on the 
next line, and if it moves to a different scene 
function. It will also change anything that is 
different without filling up the buffer more 
than needed. Where we've made no change is 
labelled with a O in the scripts. 


pygame window 


a 


~ code here is very expandable, 
allowing you to add decisions that take 
you to different scenes il 


1 The starting function 

We finish our code bit with a simple 
function that starts off the entire game. This is 
just to encapsulate the entire code and allows us 
to add different ways of turning it off in the future. 
IDLE when running the file will load everything 
up and then run the game() function at the end 
— this is similar to how you can add a ___main__ 
function at the end which will start the code in the 
command line. 


1 6 Expand your code 


The code written is very expandable, 
allowing you to add decisions that are logged 
to take you to different scenes (or routes in 
visual novel terminology) and make your game 


feel more interactive. This would not require 
much more code than the if statements, and 
it would also be a good way for you to look into 
adding graphical buttons to click and use the 
collide function. 


1 Move the assets 

Currently the code has the script- 
specific assets in the main visualnovel file. 
These can be moved to the script, allowing 
you to make the visualnovel file much more 
modular so that can you have multiple scripts 
with different assets to load at startup. 
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BREAKOUT 


Pygame Zero 


Resources 


Pygame Zero: 


Code from FileSilo (optional) 
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Games are a great way of understanding a 
language: you have a goal to work towards, and 
each feature you add brings more fun. However, 
games need libraries and modules for graphics 
and other essential games features. While the 
Pygame library made it relatively easy to make 
games in Python, it still brings in boilerplate code 
that you need before you get started — barriers to 
you or your kids getting started in coding. 

Pygame Zero deals with all of this boilerplate 
code for you, aiming to get you coding games 
instantly. PgO (as we'll abbreviate it) makes 
sensible assumptions about what you'll need for 
agame — from the size of the window to importing 
the game library — so that you can get straight 
down to coding your ideas. 


SCORE 
6661266 


Pg0’s creator, Daniel Pope, told us that the 
ibrary “grew out of talking to teachers at Pycon 
Uk’s education track, and trying to understand 
that they need to get immediate results and 
break lessons into bite-size fragments, in order 
to keep a whole class up to speed.” 

To give you an idea of what’s involved here, 
we'll build up a simple game from a Pong- 
type bat and ball through to smashing blocks 
Breakout-style. The project will illustrate what 
can be done with very little effort. Pg0 is in 
early development but still offers a great start 
— and is now included on the Pi in the Raspbian 
Jessie image. 

We'll look at installation on other platforms, 
but first let’s see what magic it can perform. 


Right Breakoutis 
aclassic arcade 
game that can 
be reimagined in 
Pygame Zero 


Youn 
and old 


EEE 


In situations where 
Pygame is used 
boilerplate and all 
with young people, 
great results can 
also be achieved 
(see Bryson 
Payne’s book), 

but Pygame and 
Pg0, despite their 
use as powerful 
educational tools, 
are also good for 
creating games for 
coders no matter 
what stage of 
learning they are at. 


Great games are all 
about the gameplay, 
driven by powerful 
imaginations 
generating images, 
animations, sounds 
and journeys 
through game 
worlds. Good 
frameworks open 
up this creative 
activity to people 
whoare not 
traditional learners 
of programming, 
which is an area 
where Python has 
long excelled. 
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O Zero effort 

Although game writing is not easy, getting started 
certainly is. If you've got Raspbian Jessie installed on your Pi, 
you're ready to go. Open a terminal and type: 


touch example.py 
pgzrun example.py 


And you'll see an empty game window open (Ctrl+Q will close the 
window). Yes, it’s that easy to get started! 


@) Python 3 

If you haven't got Raspbian Jessie, chances are you'll 
have neither PgO nor Pygame installed. The Python's pip package 
installer will take care of grabbing PgO for you, but the preceding 
steps vary by distro. One thing you will need is Python 3.2 (or 
newer). If you’ve been sticking with Python 2.x in your coding 
(perhaps because it’s used in a tutorial you're following), make 
Pg0 your chance for a gentle upgrade to Python 3. 


@) Older Raspbian 
If youre still running Raspbian Wheezy, you'll need to run 
the following steps to install Pygame Zero: 


sudo apt-get update 
sudo apt-get install python3-setuptools python3-pip 
sudo pip-3.2 install pgzero 


O04 No Pi? 

You don’t even need a Raspberry Pi to install Pygame 
Zero — just install the Pygame library, then use pip to install 
Pygame Zero. Instructions vary by distro, but a good place to 
start is the documentation: bit.ly/1GYZnUB. 


05 Intro.py 

That default black square of 800 by 600 pixels we 
saw in Step 1 can now be overridden manually. For example, 
we can use the following code to replace it with an oversized 
gold brick, in asly nod to Breakout: 


WIDTH = 100 
HEIGHT = 100 
def draw(): 

screen.fi11((205, 130, @)) 


That colour tuple takes RGB values, so you can quickly 
get colours off a cheatsheet; screen is built into PgO for 
the window display, with methods available for all sorts of 
different sprites... 


a 
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Right The bat 

and ball come 
first — they’re the 
cornerstones of 
Pongand Breakout 


Program 
objects 


a 


David Ames, who 
uses Pg0 to teach 
younger children 
to code at events 
across the UK, 
told us: “One thing 
to avoid when it 
comes to teaching 
kids is Object 
Orientation.” OOP 
(object-oriented 
programming) is 
partly abstracted 
away by Pg0, but it 
can’t be ignored. 


Perhaps the best 
approach is using 
Pg0 and some 
simple code to 
start, then dropping 
ina piece of OO 
when it’s needed to 
solve a particular 
problem. 


With the Code Club 
age group — about 
eight to eleven — 
feeding information 
to solve practical 
problems works 
well. It can work 
with adults, too — 
but there’s always 
someone who’s 
read ahead and 
has a few tricky 
questions. 
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0 Sprite 

The intro example from the Pg0 docs expands on that 
with the Actor class, which will automatically load the named 
sprite (PgO will hunt around for a jpg or .png in a subdirectory 
called images). 
alien = Actor(‘alien’) 
alien.pos = 100, 56 
WIDTH = 52 
HEIGHT = alien.height + 
def draw(): 

screen.clear() 

alien.draw() 
You can download the alien from the PgO documentation (bit. 
ly/1Sm5IM7) and try out the animation shown there, but we're 
taking a different approach in our game. 


07 Breakout via Pong 
While the Pi is something of a tribute to 1980s 8-bit 


computers, Breakout comes from the 1970s and is a direct 
descendant of the early arcade classic Pong. We'll follow the 
route from Pong to Breakout (which historically involved Apple 
founders Steve Wozniak and Steve Jobs) in the steps to creating 
our code, leaving you with the option of developing the Pong 
elements into a proper game, as well as refining the finished 
Breakoutclone. 


08 Batty 

You can think of Breakout as essentially being a 
moving bat — that is, you're hitting a moving ball in order to 
knock out blocks. The bat is a rectangle, and Pygame’s Rect 
objects store and manipulate rectangular areas — we use 
Rect((left, top), (width, height)), before which we define the bat 
colour and then call upon the draw function to put the bat on 
the screen, using the screen function. 


Rect((W/2, 2. 
def draw(): 
screen.clear() 
screen.draw.filled_rect(bat, RED) 
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96 x H), (150, 15)) 
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09 Mouse move 
We want to move the bat, and the mouse is closer to an 


arcade paddle than the arrow keys. Add the following: 
def on_mouse_move(pos): 

x, y = pos 

bat.center = (x, bat.center[1]) 


Use pgzrun to test that you have a screen, bat and movement. 


Bt get the ball to move we need 
to define move(ball) for each case 
where the ball meets a wall il 


Full code listing 


from collections import namedtuple 
import pygame 

import sys 

import time 


= 
iT] 
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RED = 200, 0, @ 
WHITE = 200,200, 200 
GOLD = 205,145,0 


= 
iT] 


ball = Rect((W/2, H/2), (30, 30)) 
Direction = namedtuple(‘Direction’, ‘x y’) 
ball_dir = Direction(5, -5) 


bat = Rect((W/2, 2.96 * H), (120, 15)) 
class Block(Rect): 
cef __init__(self, colour, rect): 
Rect.__init__(self, rect) 


self.colour = colour 


blocks = [] 
for n_block in range(24): 


block = Block(GOLD, ((((n_block % 8)* 100) + 2, ((n_block // 


8) * 25) + 2), (96, 23))) 
blocks. append(block) 


def draw_blocks(): 
for block in blocks: 
screen.draw.filled_rect(block, block.colour) 


def draw(): 
screen.clear() 
screen.draw.filled_rect(ball, WHITE) 
screen. draw. filled_rect(bat, RED) 
draw_blocks() 


def on_mouse_move(pos): 
X, Y = pos 
bat.center = (x, bat.center[1]) 


def on_mouse_down(): 
global ball_dir 


ball_dir = Direction(ball_dir.x * 1.5, ball_dir.y * 1.5) 


1 Square ball 

In properly retro graphics-style, we define a square 
ball too — another rectangle, essentially, with the (30, 30) size 
making it that subset of rectangles that we call a square. 

We're doing this because Rect is another built-in in PgO. If we 
wanted a circular ball, we’d have to define a class and then use 
Pygame’s draw.filled_circle(pos, radius, (r, g, b)) - but Rect we 
can call directly. Simply add: 


WHITE = 200,200,200 
ball = Rect((W/2, H/2), (32, 30) 


... tothe initial variable assignments, and: 
screen.draw.filled_rect(ball, WHITE) 


... to the def draw() block. 


1 Action! 

Now let’s make the ball move. Download the tutorial 
resources in FileSilo.co.uk and then add the code inside the 
‘move.py’ file to assign movement and velocity. Change the 5 in 
ball_dir = Direction(5, -5) if you want the ball slower or faster, 
as your processor (and dexterity) demands - but it’s hard to 
tell now because the ball goes straight off the screen! Pg0 will 
call the update() function you define once per frame, giving the 
illusion of smooth(ish) scrolling if you’re not running much else. 


1 def move(ball) 

To get the ball to move within the screen we need to 
define move(ball) for each case where the ball meets a wall. 
For this we use if statements to reverse the ball’s direction at 
each of the boundaries. Refer to the full code listing on page 67. 

Note the hardcoded value of 781 for the width of screen, 
minus the width of ball — it’s okay to hardcode values in 
early versions of code, but it’s the kind of thing that will need 
changing if your project expands. For example, a resizable 
screen would need a value of W - 30. 


1 Absolute values 

You might expect multiplying y by minus one to work for 
reversing the direction of the ball when it hits the bat: 
ball_dir = Direction(ball_dir.x, -1 * ball_dir.y) 
... but you actually need to use abs, which removes any minus 
signs, then minus: 
ball_dir = Direction(ball_dir.x, - abs(ball_dir.y)) 


Try it without in the finished code and see if you get some 
strange behaviour. Your homework is to work out why. 


a 
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Right Tom Viner’s 
array of blocks 
negates the need for 
bordered rectangles 


—__—__——_ 


Pg0 +1 
= 


There’s anew 
version of Pg0 in 
development — it 
may even be out 

as you read this. 
Pg0 creator Daniel 
Pope tells us “atone 
generation API isin 
the works,” and that 
at the Pg0 PyConUK 
sprint, “we finished 
Actor rotation.” 


Contributions are 
welcome — not only 
to the Pg0 code, but 
more examples are 
needed not just to 
show what can be 
done, but to give 
teachers tools to 
enthuse children 
about the creative 
act of programming. 


Pg0 has also 
inspired GPIO 

Zero, to make 

GPIO programming 
easier on the 
Raspberry Pi, with 
rapid development 
occurring on this 
new library as we go 
to press. 
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iner/breakout x v 


mm: tomvinor/broeakout.qit 


1 Sounds 
Also upon bat collision, sounds.blip.play() looks in 
the sounds subdirectory for a sound file called blip. You can 
download the sounds (and finished code) from FileSilo.co.uk. 
Actually, now we think about it, ignore the previous 
comment about homework — your real homework is to turn 
what we've written so far into a proper game of Pong! But first 
let’s finish turning it into Breakout! 


1 Blockhead! 
If you’re not very familiar with the ancient computer 
game Breakout, then: 
apt-get install lbreakout2 
... and have a play. Now, we haven't set our sights on building 
something quite so ambitious in just these six pages, but we 
do need blocks. 


1 6 Building blocks 

There are many ways of defining blocks and distributing 
them onto the screen. In Tom Viner’s team’s version, from 
the London Python Dojo — which was the code that originally 
inspired this author to give this a go — the blocks are sized in 
relation to number across the screen, thus: 


N_BLOCKS = 8 

BLOCK_W = W / N_BLOCKS 

BLOCK_H = BLOCK_W / 4 
BLOCK_COLOURS = RED, GREEN, BLUE 


Using multicoloured blocks which are then built into an 
array means that blocks can join without needing a border. 
With its defining variables in terms of screen width, it’s good 
sustainable code, which will be easy to amend for different 
screen sizes — see github.com/tomviner/breakout. 

However, the array of colour bricks in a single row is not 
enough for a full game screen, so we're going to build our array 
from hard-coded values... 


+nwvne gv 


1 Going for gold 


Create a Block class: 


class Block(Rect): 
def _ init__(self, colour, rect): 


Rect.__init__(self, rect) 
self.colour = colour 


...and pick a nice colour for your blocks: 


GOLD = 205,145,0 


1 8 Line up the blocks 
This builds an array of 24 blocks, three rows of eight: 


blocks = [] 
for n_block in range(24): 
block = Block(GOLD, ((((n_block % 8)* 102) + 2, 
((n_block // 8) * 25) + 2), (96, 23))) 
blocks.append(block) 


1 Drawing blocks 
Draw_blocks() is added to def draw() after defining: 


def draw_blocks(Q): 
for block in blocks: 
screen.draw.filled_rect(block, block.colour) 


20 Block bashing 
All that remains with the blocks is to expand def 


move(ball) — to destroy a block when the ball hits it. 

to_kill = ball.collidelist(blocks) 

if to_kill >= 2@: 
sounds.block.play() 
ball_dir = Direction(ball_dir.x, abs(ball_dir.y)) 
blocks.pop(to_kill) 


Full code listing (cont.) 


def 


def 


move(ball): 
elobal ball_dir 
ball .move_ip(ball_dir) 


if ball.x > 781 or ball.x <= Q: 

ball_dir = Direction(-1 * ball_dir.x, ball_dir.y) 
if ball.y <= Q: 

ball_dir = Direction(ball_dir.x, abs(ball_dir.y)) 
if ball.colliderect (bat): 

sounds.blip.play() 

ball_dir = Direction(ball_dir.x, - abs(ball_dir.y)) 


to_kill = ball.collidelist (blocks) 

if to_kill >= @: 
sounds .block.play() 
ball_dir = Direction(ball_dir.x, abs(ball_dir.y)) 
blocks. pop(to_kil1l) 


if not blocks: 
sounds .win.play() 
sounds.win.play() 
print C“Winner!’?) 
time.sleep(1) 
sys.exit() 


if ball.y > H: 
sounds .die.play() 
print(“Loser!”) 
time.sleep(1) 
sys.exit() 


update(): 
move (ball) 


Left Test your game 
once it’s finished 

— then test other 
people’s Breakout 
games to see how 
the code differs 


2 Game over 

Lastly, we need to allow for the possibility of successfully 
destroying all blocks. 
if not blocks: 

sounds.win.play() 

sounds.win.play() 

print(“Winner!”) 

time.sleep(1) 

sys.exitQ) 


2 Score draw 

Taking advantage of some of Pygame Zero’s quickstart 
features, we've a working game in around 60 lines of code. 
From here, there’s more PgO to explore, but a look into Pygame 
unmediated by the PgO wrapper is your next step but one. 

First refactor the code; there’s plenty of room for improvement 
— see the example ‘breakout-refactored.py’ which is included in 
your tutorial resources. Try adding scoring, the most significant 
absence in the game. You could try using a global variable and 
writing the score to the terminal with print(), or instead use 
screen.blit to put it on the game screen. Future versions of PgO 
might do more for easy score keeping. 


2 Class of nine lives 

For adding lives, more layers, and an easier life-keeping 
score, you may be better defining the class GameClass and 
enclosing much of the changes you wish to persist within it, 
such as self.score and self.level. You'll find a lot of Pygame code 
online doing this, but you can also find Pg0 examples, such as the 
excellent pi_lander example by Tim Martin: github.com/timboe/ 
pi_lander. 


2 4 Don’t stop here 
This piece is aimed at beginners, so don’t expect to 


understand everything! Change the code and see what works, 
borrow code from elsewhere to add in, and read even more code. 
Keep doing that, then try a project of your own — and let us know 


how you get on. &@ 


hk 


The Python Book 133 


Web 


136 Develop with Python 
Why Python is perfect for the web 
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142 Creating dynamic templates 
Use Flask and Jinja2 to their full potential 


146 Build your own blog 
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150 Deliver content to your blog 
Add content to your site 
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154 Enhance your blog 
Complete your blog with add-ons 
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Blog Feed 


“Python is a versatile language, 
perfect for making websites” 
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Don't be fooled into thinking Python Is a restrictive | anguag SOF 
incompatible with the modern web. Explore options for bul ding 
Python web apps and experience rapid application development 
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Frameworks 


Django 
GOOD FOR: Large database-driven web apps with multiuser support 
and sites that need to have heavily customisable admin interfaces 


Django contains a lot of impressive features, all in the name of interfaces 
and modules. These include autowiring, admin interfaces and database 
migration management tools by default for all of your projects and 
applications. Django will help to enable rapid application development for 
enterprise-level projects, whilst also enabling a clear modular reuseable 
approach to code using subapplications. 


Flask 


GOOD FOR: Creating full-featured RESTful APIs. Its ability to manage 
multiple routes and methods is very impressive 


Flask’s aim is to provide a set of commonly used components such as 
URL routing and templates. Flask will also work on controlling the request 
and response objects, all-in-all this means it is lightweight but is still a 
powerful microframework. 


Werkzeug 


GOOD FOR: API creation, interacting with 
databases and following strict URL routes 
whilst managing HTTP utilitie 


Werkzeug is the underlying framework for 
Flask and other Python frameworks. It provides 


Let’s take a look at some of the frameworks 
available when developing Python web applications 


Tornado 


GOOD FOR: Web socket interaction and long polling due to its 
ability to scale to manage vast numbers of connections 


Tornado is a networking library that works as a nonblocking web server 
and web application framework. It’s known for its high performance and 
scalability and was initially developed for friendfeed, which was a real- 
time chat system that aggregated several social media sites. It closed 
down in April 2015 as its user numbers had declined steadily, but Tornado 
remains as active and useful as ever. 


PyramiD 


GOOD FOR: Highly extensible and adaptable to any project 
requirement. Not a lightweight system either 


Heavily focused on documentation, Pyramid brings all the much needed 
basic support for most regular tasks. Pyramid is open source and 
also provides a great deal of extensibility — it comes with the powerful 
Werkzeug Debugger too. 


Flask 


web development, 
one drop at a time 


overview // docs // community // snippets // extensions // search 


a unique set of tools that will enable you to 
perform URL routing processes as well as 
request and response objects, and it also 
includes a powerful debugger. 


Flask is a microframework for Python based on Werkzeug, Jinja 2 and 
good intentions. And before you usk: It’s BSD licensed! 


Flask is Fun 


Latest Version: 0.10.1 
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Create an API 


Install Flask 

Create a new directory 
which your project will live. Open a Terminal 
window and navigate to be inside your new 
directory. Create a new virtual environment 
for this project, placed inside a new directory 


01 


inside of 


called ‘venv, and activate it. Once inside 
the new virtual shell, proceed to installing 
Flask using the ‘pip install Flask’ command. 


virtualenv venv 
. venv/bin/activate 
pip install Flask 


0 Create Index 

Create a new file in the root of the 
project location called ‘index.py’. The sample API 
will use a SQLite database, so we need to import 
that module for use in the application. We'll 
also import some core components from the 
Flask module to handle request management 
and response formatting as well as some other 
functions. The minimum import for a Flask 
application is Flask itself. 


import sqlite3 

from flask import Flask, request, g, 
redirect, url_for, render_template, 
abort, jsonify 


0 Declare Config 

For a small application we can declare 
configuration options as upper-case name value 
pairs inside the main module, which we'll do now. 
Here we can define the path and name of the 
SQLite database and also set the Flask debug 
output to True for development work. Initialise 
the Flask application to a namespace and then 
import the config values set directly above it. 
We then run the application. All routes must be 
placed above these last two lines. 


# Config 
DATABASE = ‘/tmp/api.db’ 
DEBUG = True 


app = Flask(__name__) 
app.config.from_object(__name__) 
# Add methods and routes here 
if __name_ main__’: 
app.run() 
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0 Connect to Database 

With the database path defined, 
we need a way to create connection to the 
database for the application to obtain data. 
Create a new method called ‘connet_db’ to 
manage this for us. As a method we can call it 
when we set up a prerequest hook shortly. This 
will return a new open connection using the 
database details set in the configuration object. 


def connect_db(): 
return sqlite3.connect(app. 
configL ‘DATABASE’ ]}) 


05 Database Schema 
Our SQLite database will only contain 


one table. Create a new file called ‘schema.sql’ 
in the root of the project directory. This fill will 
contain the SQL commands required to create 
the table and populate it with some sample 
bootstrapped data. 


drop table if exists posts; 
create table posts ( 
id integer primary key autoincrement, 
title text not null, 
text text not null 
»; 
insert into posts (title, text) values 
(‘First Entry’, ‘This is some text’); 
insert into posts (title, text) values 
(‘Second Entry’, ‘This is some more text’); 


insert into posts (title, text) values 
(‘Third Entry’, ‘This is some more text 
(again)’); 


06 Instantiate the Database 

To populate the database with the new 
table and any associated data, we will need to 
import and apply the schema to the database. 
Add a new module import at the top of the 
project file to obtain the ‘contextlib.closing()’ 
method. What we will do next is create a method 
that will initialise the database by reading the 
contents of schema.sql and executing it against 
the open database. 


Let us explore the Flask microframework and build a 
simple yet powerful R 


ESTful API with minimal code 


from contextlib import closing 
def init_db(): 
with closing(connect_db(Q)) as db: 
with app.open_resource(‘schema.sql’, 
mode=’r’) as f: 
db.cursor().executescript(f.read()) 
db.commit() 


15 24, 10:01; 4) 
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07: i apeaal Database 

populate the database you 
can now run the init_db inside an active 
python shell. To do so enter a shell by typing 
‘python’ inside your environment, and then 
running the command below. Alternatively, 
you can use the sqlites command and 
pipe the schema.sql file into the database. 


# Importing the database using the 
init_db method 

python 

>>> from index import init_db 

>>> init_dbQ 

# Piping the schema using SQLite3 
sqlite3 /tmp/api.db < schema.sql 


08 Request DB Connection 
With the database created and 


populated we need to be able to ensure 
we have an open connection and close it 
accordingly when finished. Flask has some 
decorator methods to help us achieve this. 
The before_request() method will establish 
the connection and stores it in the g object 
for use throughout the request cycle. We 
can then close the connection after the 
cycle using the teardown_request() method. 


@app.before_request 
def before_request(): 
g.db = connect_dbQ); 


“World-renowned image sharing service 
Instagram and social pin board Pinterest 
have also implemented Python as part of 
their web stack, opting for Django” 


@app.teardown_request 
def teardown_request(exception): 
db = getattr(g, ‘db’, None) 
if db is not None: 
db.close() 


@) Display Posts 

Create your first route so that we can 
return and display all available posts. To query 
the database we execute a SQL statement 
against the stored db connection. The results 
are then mapped to values using Python's 
dict method and saved as the posts variable. 
To render a template we then call render_ 
template() and pass in the file name and the 
variable to display as the second argument. 
Multiple variables can be passed through as a 
comma-separated list. 


@app.route(‘/’) 
def get_posts(): 

cur = g.db.execute(‘select title, text 
from posts order by id desc’) 

posts = [dict(title=row[@], text=row[1]) 
for row in cur.fetchallQ] 

return render_template(‘show_posts. 
html’, posts=posts) 


1 Template Output 

Flask expects templates to be available 
within the templates directory in the root of 
the project, so make sure that you create that 
directory now. Next, add a new file called 
‘show_posts.html. The dynamic values are 
managed using Jinja2 template syntax, the 
default templating engine for Flask applications. 
Save this file in the templates directory. 


<ul class=posts> 

{% for post in posts %} 

<li><h2>{{ post.title }}</h2>{{ post. 
text|safe }} 

{% else %} 

<li>Sorry, no post matches your 
request. 

{% endfor %} 
</ul> 


1 Make an API Response 

To create an API response we can 
define a new route with a specific API endpoint. 
Once again, we query the database for all 
posts. The data is then returned as JSON, 
using the JSONify method to do so. We can 
add specific values such as post count and 
a custom message if you wish, as well as the 
actual posts variable, formatted as JSON. 


@app.route(‘/api/v1/posts/’, 
methods=[‘GET’ ]) 
def show_entries(): 

cur = g.db.execute(‘select title, text 
from posts order by id desc’) 


posts = [dict(title=row[@], 
text=row[1]) for row in ur.fetchallQ] 

return jsonify({‘count’: len(posts), 
‘posts’: posts}) 


1 Get a specific Post 

CTo obtain a specific post from the 
API we need to create a new route, which will 
accept a dynamic value as part of the URI. We 
can also choose to use this route for multiple 
request methods, which are in this case GET 
and DELETE. We can determine the method 
by checking the request.method value and 
run it against a conditional if/else statement. 


Gapp. route(‘/api/v1/posts/<int:post_id>’, 
methods=[‘GET’, ‘DELETE’ ]) 
def single_post(post_id): 
method = request.method 
if method == ‘GET’: 
cur = g.db.execute(‘select title, 
text from posts where id =?’, [post_id]) 
posts = [dict(title=row[@], 
text=row[1]) for row in cur.fetchall()] 
return jsonify({‘count’: len(posts), 
‘posts’: posts}) 
elif method == ‘DELETE’: 
g.db.execute(‘delete from posts 
where id = ?’, [post_id]) 
return jsonify({‘status’: ‘Post 
deleted’ }) 


1 Run the application 

To run your Flask application, navigate 
using the active Terminal window into the 
root of the project. Ensuring you are in an 
active virtual environment Python — shell, 
enter the command to run the main index 
file. The built-in server will start and the site 
will be accessible in the browser on default 
port local address = http://127.0.0.1:5000. 


python index.py 


1 API JSON Output 

The root of the application will render 
the template we previously created. Multiple 
routes can be generated to create a rich web 
application. Visiting an APl-specific URL in 
the browser will return the requested data as 
cleanly formatted JSON. The ability to define 
custom routes like a versioned RESTful endpoint 
is incredibly powerful. 


imalelamia 
the wild 


Interested in Python development? 
N(oleKon o\-mlancielelenere)anley-laN ay iinan oll cs 
names currently using it 


Disqus, the popular social interaction 
comment service provider, lately 
been implementing their production 
applications in Python for a very long time. 
Python’s benefit for the development 
team was its ability to scale effectively 
and cater for a large number of consumers 
whilst also providing an_ effective 
underlying API for internal and external 
use. The company are now starting to 
run some production apps in Go, but the 
majority of code still runs on Python. 

World-renowned image sharing service 
Instagram and social pin board Pinterest 
have also implemented Python as part of 
their web stack, opting for Django to assist 
with the functionality and ability to cater 
for the many thousands of content views 
and requests made to their services. 

Mozilla, Atlassian’s Bitbucket 
repository service, and popular satire site 
The Onion have all been noted as using 
Django for their products. 
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Django application 


development 


Installing 
Django 


The installation of Django is 
relatively easy once you have 
python installed. See for yourself 
as we build a simple app here 


Getting started with Django 


Install Django 
Write your first Dyango app 


0 Create Virtual Environment 
Create a new directory for your project 
and navigate inside it using a new Terminal 
window. Create a new virtual environment for 
this project, opting to use the latest Python 3. 
Your Python 3 location may vary, so be sure to 
set the correct path for the binary package. 


virtualenv -p /usr/local/bin/python3 venv 
@) Activate and Install 

Using your Terminal window, 
activate the virtual environment to start the 
project-specific shell. VirtualEnv has a local 
version of the Python package manager 


pip installed, so it’s fairly straight forward 
to run the command to install Django. 


. venv/bin.activate 
pip install Django 
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Create Core Project 
The Django install 


0 


fresh project structure for us. Run the django- 
you want created. 
django-admin.py startproject myblog 


ese © coldtunonkeh@Matts-Mac: -/Desktop/python_code 
Cvenv}* django dijango-odmin.py stortproject myblog 
Cvenv}* django 1s -1 

total 6 

drvxr-xr-x 4 coldfumonkeh staff 136 Jon 3 22:08 myblog 
drvoe-xr-x 6 coldfumonkeh stoff 284 Jon 3 21:31 venv 
(verv) django §j 


Initial Migration 


0 


database tables. 


Using the helper. run a migration command to 
create all of these automatically. The Terminal : 
window will keep you informed of all of your 
progress and what has been applied from the : 


02 Data Migration 
i Any creation of models or changes to 


data need to be migrated. To do so we need 
i to make migration files from the model data, 
: which generate sequentially numbered files. 


migration. 


cd myblog 
python manage.py migrate 


0 


Create App 


module, which will generate the 


python manage.py startapp blog 


contains some : 
incredibly useful command-line tools, which H 
will help you to run a number of repetitive and : 
difficult tasks. Let’s use one of them to create a : 
admin.py script with the name of the project that : 0 
: first model class, providing the property names 
: and types for each. You can dig deeper into 
: field types via the docs here: bit.ly/1yln1kn. 
: Once complete, open myblog/settings.py and 
: add the blog app to the list of allowed installed 
: applications so that the project will load it. 


Navigate into the project directory via 
the Terminal window. Some of the installed : 
apps included in the project generation require : 


Each Django project is made up of 
at least one application or module. Run the : 
startapp command to create a new blog app : 
required : 
code adjacent to the main project structure. 
: python manage.py sqlmigrate blog 0001 
: python manage.py migrate__ 


Django is a full Python web-app framework 
with impressive command-line tools 


Database 
models 
& migration 


database schema and project 
models is very impressive 


Generate the model 
Open blog/models.py and create the 


: # blog/models.py 
i class Post(models.Model): 


title = models.CharField(max_ 


© length=20@) 


text = models.TextField() 


: # myblog/settings.py 
: INSTALLED_APPS = (‘django.contrib.admin’, 


... ‘django.contrib.staticfiles’, ‘blog’) 


MD) coldfumonkeh@Matts-iMac; ~/Desktop/python_co| 


+ myblog python monoge.py sqlmigrote blog 0001 

BEGIN; 

CREATE TABLE “blog_post” ("id" integer NOT NULL PRIMARY, 
L, “text” text NOT NULL); 


COMMIT; 
+ myblog | 


Then we run a specific migration to generate 
the required SQL and the final migrate 
command performs the database execution. 


python manage.py makemigrations blog 


Autowiring the 
admin interface 


Admin sections can be 
problematic in their own right. 
Django provides an extensible 
admin interface for you 


™) coldfumonkeh@Matts-iMac: ~{ 
ango/mybdiog | 
~~ myblog python monoge.py crectesuperuser 
ee Ge le Meee Melee | ee 
Email address: myemai l@domain.com 

Password: 


Password (again): 
Superuser created successfully. 
+> myblog | 


@) Create Admin User 

Django makes content administration 
incredibly easy and has an admin section 
available in a default project as standard 
at http://127.0.0.1:8000/admin. To log in you 
need to create a superuser account. Run 
the associated command and specify user 
details as required to then proceed and log in. 


python manage.py createsuperuser 


0 Switch on blog management 

Having logged in to the administration 
interface you will be greeted with features to 
manage users and group roles and privileges, 
which alone are very powerful and provided for 
you by Django. There is not yet, however, any 
access to manage our blog posts so let’s turn 
that on. 


Using the 
dev server 


Django ships with a very helpful built-in 
development server, which will help you 
out by autocompiling and reloading 
after you have completed all of your file 
changes. All you have to do to start 
the server is to run the ‘python 
manage.py runserver’ command from 
your Terminal window within 
the project directory. 


03 Enable Admin Management 

To enable our module and associated 
models to be managed through the admin 
interface, we need to register them with the 
admin module. Open blog/admin.py and then go 
on to import and register the models in turn (we 
only have one of these currently though). Save 
the file and refresh the admin site to see the 
posts that are now available to manage. 


from django.contrib import admin 
# Register your models here. 


0 Create a View 

With the admin interface accepting 
new submissions for our post class we'll create 
a view page to display them. Open blog/views. 
py and import the Post class from the models. 
Create a method to obtain all posts from the 
database and output them as a string. 


from django.http import HttpResponse 
from blog.models import Post 
def index(request): 

post_list = Post.objects.order_by(‘-id’) 
[5] 

output = ‘<br />’.join([p.title for p 
in post_list]) 


return HttpResponse(output) 


0 Manage the URLs 

Create ‘blog/urls.py’ and add the code 
to import the views that were just made in the 
module and the accompanying URL patterns. 
Open myblog/urls.py and add the URL function 
call to implement a new URL for the app to 
display the view. Visit http://127.0.0.1:5000/ 
blog in your browser to render the new view. 


# blog/urls.py 


from django.conf.urls import patterns,url 
from blog import views 
urlpatterns = patterns(’’, 

url(r’*$’, views.index, name=’index’), 


) 


# myblog/urls.py 

urlpatterns = patterns(‘’, 
url(r’*blog/’, include(‘blog.urls’)), 
url(r’*admin/’, include(admin.site.urls)), 


) 


Hosting 


Python 
apps 


Admin sections can be 
problematic in their own right. 
Django provides an extensible 
admin interface for you 


Heroku heroku.com 


This app is perhaps one of the most well- 
known cloud hosting providers. Their stack 
server environments support a number 
of core web app languages including 
Python as standard. Their unique Toolbelt 
command-line features and integration 
with Git repositories, as well as being 
incredibly quick and easy to scale and 
improve performance, makes them an 
obvious choice. A free account will let you 
run a Python web app on one dyno instance 
without any cost. 


Host, run, and code Python in the cloud! 


Ca erred hr Pe OF aR ON GRE YO ROR NS TPIT WE er ry 
ea a Re UL NL ORE ARN YE A omy OY ad em A 
rer 


ee ne pemee oga pare seat at Bee 


I 
Python Anywhere 


www.pythonanywhere.com 
Another hosted option, and one created 
specifically for Python applications in 
general is Python Anywhere. The free 
basic option plan has enough weight and 
power behind it to get you up and running 
with a Python web app without having to 
scale, but as soon as your project gains 
traction, you can switch plans and boost 
your plans performance. 

lt offers an incredibly impressive range 
of modules as standard, available to import 
into your application immediately to get you 
started, including Django and Flask should 
you need them. 
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Creating dynamic templates 
with Flask, Jinja2 and Twitter 


Create a dynamic webpage with Twitter and Flask’s rendering 


engine, Jinja2 


Resources 
Python 2.7+ 

Flask 0.10.0: flask.pocoo.org 
Flask GitHub: 


github.com/mitsuhiko/flask 
A Twitter account 
Your favourite text editor 
Code downloaded from FileSilo 


Python and Flask are a great combination 
when you're looking to handle the Twitter 
OAuth process and build requests to obtain 
tokens. We've used Twitter here because of 
the large amount of easily digestible data 
available on it. However, since Twitter adheres 
to the standards set out by OAuth 1.0, the code 
we've used to sign and build requests can 
be modified to work with any third-party API 
using the same standard without a great deal 
of work. For years PHP has been a mainstay 
of template generation, but now with well- 
documented frameworks such as Flask, 
Sinatra and Handlebars, the ability to use 
powerful scripting languages greatly improves 
our ability to make great web services. Here, 
were going to use Python, Flask and its 
templating engine to display tweets. Flask 
comes with the super-nifty Jinja2 templating 
engine, If you’re familiar with Node.js or front- 
end JavaScript, the syntax will look very 
similar to the Handlebars rendering engine. 
But, before we dive into that, we need to 
organise some of the example code that we're 
using for this. 
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m™ The template uses a loop to generate a list of Twitter tweets 


0 Rearranging our code 

Server code can get messy and 
unmaintainable quickly, so the first thing we're 
going to do is move our helper functions to 
another file and import them into our project, 
much like you would a module. This way, it will 
be clear which functions are our server logic 
and endpoints and which are generic Python 
functions. Open the TwitterAuthentication file 
downloaded from FileSilo (stored under Twitter 
OAuth files) and locate the getParameters, 
sign_request and create_oauth_headers 
functions. Cut and paste them into a new file 
called helpers.py in the root of your project 
folder. At the top of this file we want to import 
some libraries. 


import urllib, collections, hmac, «! 
binascii, time, random, string 


from hashlib import shal 
Now we can head back over to server.py and 


import the helper functions back into our 
project. We do this by simply calling import 


helpers. Because Python is smart, It will look 
in the current directory for a helpers.py file 
before it looks for a system module. Now every 
function included in helpers.py is accessible 
to our project. All we need to do to call them is 
prepend our the methods we called before with 
helper.function_name and it will execute. For 
sign_request, we'll need to pass our 
oauth_secret and consumer_secret for each 
request rather than accessing it from the 
session. Adjust the function declaration like so: 


def sign_request(parameters, method, «1 
baseURL, consumer_secret, oauth_secret): 


02 server.py modules 
With a lot of the modules needed in this 


project having been moved to helpers.py, we 
can now remove most of them from server.py. 
If we amend our first import statement to be... 


import urllib2, time, random, json 


...our project will continue to function as it did 
before. Note the addition of the json module: 


we'll be using that later as we start handling 
Twitter data. 

Having Flask use a rendering engine is 
super-simple. Flask comes packaged with 
the Jinja2 template rendering engine, so we've 
nothing to install - we just need to import the 
package into the project. We can do this by 
adding render_template to the end of our from 
flask import L..] statement. 


@) Our first template 

Now that we have a rendering engine, 
we need to create some templates for it to 
use. In the root of our project’s folder, create 
a new folder called templates. Whenever 
we try to render a template, Flask will look in 
this folder for the template specified. To get 
to grips with templating, we'll rewrite some 
of our authentication logic to use a template, 
rather than manually requesting endpoints. In 
templates, create an index.html file. You can 
treat this HTML file like any other — included in 
the resources for this tutorial is an index.html 
that includes all of the necessary head tags and 
<!IDOCTYPE> declarations for this file. 


0 Rendering our template 
In server.py, let’s create a route for 7’ to 
handle the authorisation process. 


@app.route(‘/’) 
def home(): 


if not ‘oauth_token’ in session: 
session.clear() 
session[‘oauth_secret’] = °’ 
session[‘oauth_token’] = °’ 


return render_template(‘index.htm1’) 


It’s a simple function: all we want to do is check 
whether or not we have an oauth_token already 
and create those properties in the Flask session 
so we don’t throw an error if we try to access 
it erroneously. In order to send our generated 
template in response to the request, we return 
render_template(‘index.html’). 


0 Template variables 

We can choose to send variables to our 
template with render_template(‘index.htm’, 
variableOne=value, variableTwo=Value) but 
in this instance we don’t need to as each template 
has access to the request and session variables. 


a 


{% if session[‘oauth_token’] != “” %} 
<hl>Already Authorised</h1> 
<div class="dialog”> 

<p>Hello, You’ve authenticated!<br>Let’s <a href=/get-tweets’>get some tweets</a></p> 
</div> 

{% else %} 
<hl>Authorisation required</h1> 
<div class="dialog”> 

<p>We need to <a href="/authenticate’’>authenticate</a></p> 

</div> 


{% endif %} 


m The BSD-licensed Flask is easy to set up 
and use — check out the website for more info 


web development, 
one drop at a time 


overview // docs // community // snippets // extensions // search 


Flask is a microframework for Python based on Werkzeug, Jinja 2 and 
good intentions. And before you ask: It's BSD licensed! 


Flask is Fun 


import Flask 


Flask( name ) 


Latest Version: 0.10 


from flask 


Gapp. route("/") 

def hello(): 
return “Hello World!" 
name = "main 


app.run() 


And Easy to Setup 


$ pip install Flask 
$ python hello.py 


Running on 


http:// localhost :5800 


Interested? @star 9,559 


Download latest release (0.10) 
» Read the documentation or download as PDF and zipped HTML 
» Join the mailinglist 
» Forkit on github 
» Add issues and feature requests 
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Open index.html. All code executed in a Flask 
template is contained within {% %}. As this is our 
homepage, we want to direct users accordingly, 
So let’s check if we've got an access token (Fig 01). 

Between the ifs and else of the template is 
standard HTML. If we want to include some data 
— for example, the access token — we can just add 
{{ session[‘oauth_token’] }} in the HTML and it 
will be rendered in the page. Previously, in our / 
authorised endpoint, we would display the OAuth 
token that we received from Twitter; however, now 
that we have a template, we can redirect our users 
back our root URL and have a page rendered for us 
that explains the progress we've made. 


06 Getting lost 

(and then found again) 

With every server, some things get misplaced or 
people get lost. So how do we handle this? Rather 


than defining a route, we can define a handler 
that deals with getting lost. 


G@app.errorhandler(404) 
def fourOhFour@rror): 
return render_template(‘fourohfour. html’) 


If a page or endpoint is requested and triggers a 
404, then the fourOhFour function will be fired. In 
this case, we'll generate a template that tells the 
user, but we could also redirect to another page or 
dump the error message. 
0 Static files 

Pretty much every webpage uses 
JavaScript, CSS and images, but where do we 
keep them? With Flask we can define a folder 
for use with static content. For Flask, we create 
a static folder in the root of our project and 
access files by calling /static/css/styles.css or 
/static/js/core.js. The tutorial resources include a 
CSS file for styling this project. 
@) Let’s get some tweets 

So now we know how to build templates, 


let’s grab some tweets to display. In server.py 
define anew route, get-tweets, like so: 


@app.route(‘/get-tweets’) 
@app.route(‘/get-tweets/<count>’) 
def getTweets(count=@): 


You'll notice that unlike our other authentication 
endpoints, we've made two declarations. 
The first is a standard route definition: it will 
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Now we know howto build templates, 
let’s grab some tweets to display il 


intercept and handle the path get-tweets. The 
second lets us define a parameter that we can 
use as a value in our getTweets function. By 
including count=0 in our function declaration, 
we ensure that there will always be a default 
value when the function is executed; this way we 
don’t have to check the value is present before 
we access it. If a value is included in the URL, it 
will override the value in the function. The string 
inside the <variable name> determines the 
name of the variable. If you want the variable 
passed to the function to have a specific type, 
you can include a converter with the variable 
name. For example, if we wanted to make sure 
that <count> was always an integer instead of a 
float or string, we'd define our route like so: 


@app.route(‘/get-tweets/<int:count>’) 
@) Checking our session 

and building our request 
Before we start grabbing tweets, we want to 
run a quick check to make sure we have the 
necessary credentials and if not, redirect the 
user back the authorisation flow. We can do 


this by having Flask respond to the request 
with a redirection header, like so: 


if session[‘oauth_token’] == “” or 
session[‘oauth_secret’] == “”: 
return redirect(rootURL) 


Assuming we have all we need, we can start to 
build the parameters for our request (Fig 02). 

You'll notice that the nonce value is different 
from that in our previous requests. Where the 
nonce value in our authenticate and authorise 
requests can be any random arrangement of 
characters that uniquely identify the request, 
for all subsequent requests the nonce needs 
to be a 32-character hexadecimal string using 
only the characters a-f. If we add the following 
function to our helpers.py file, we can quickly 
build one for each request. 


def nonce(size=32, chars="abcdef” + <4 
string.digits): 

return ‘’.join(random.choice 
(chars) for x in range(size)) 


1 Signing and sending our request 

We've built our parameters, So let’s 
sign our request and then add the signature to 
the parameters (Fig 03). 

Before we create the authorisation headers, 
we need to remove the count and user_id 
values from the tweetRequestParams 
dictionary, otherwise the signature we just 
created won't be valid for the request. We can 
achieve this with the del keyword. Unlike our 
token requests, this request is a GET request, 
so instead of including the parameters 
in the request body, we define them as 
query parameters. 


?count=tweetRequestParams[‘count’] +! 
&user_id=tweetRequestParams[‘user_id’ ] 


1 Handling Twitter’s response 

Now we're ready to fire off the request 
and we should get a JSON response back 
from Twitter. This is where we'll use the json 
module we imported earlier. By using the 
json.loads function, we can parse the JSON 
into a dictionary that we can access and we'll 
pass through to our tweets.html template. 


tweetResponse = json. +! 
loads(httpResponse.read()) 

return render_template(‘tweets.html’, «/ 
data=tweetResponse) 


Whereas before, we accessed the session 
to get data into our template, this time 
we're explicitly passing a value through to 
our template. 


1 Displaying our tweets 

Let’s create that template now, exactly 
the same as index.html but this time, instead of 
using a conditional, we're going to create a loop 
to generate alist of tweets we've received. 

First, we check that we actually received 
some data from our request to Twitter. If we’ve 
got something to render, we're ready to work 
through it, otherwise we'll just print that we 
didn’t get anything. 

Once again, any template logic that we want 
to use to generate our page is included between 


{% %}. This time we're creating a loop; inside the 
loop we'll be able to access any property we have 
of that object and print it out. In this template 
we're going to create an <li> element for each 
tweet we received and display the user’s profile 
picture and text of the tweet (Fig 04). 

In our template we can access properties 
using either dot notation (.) or with square 
brackets ([]). They behave largely the same; 
the [] notation will check for an attribute on 
the dictionary or object defined whereas the 
. notation will look for an item with the same 
name. If either cannot find the parameter 
specified, it will return undefined. If this occurs, 
the template will not throw an error, it will simply 
print an empty string. Keep this in mind if your 
template does not render the expected data: 
you've probably just mis-defined the property 
you're trying to access. 

Unlike traditional Python, we need to 
tell the template where the for loop and if/ 
else statements end, so we do that with 
{% endfor %} and {% endif %}. 


13 Flask filters 
Sometimes, when parsing from JSON, 


Python can generate erroneous characters 
that don’t render particularly well in HTML. 
You may notice that after tweet[‘text’] there 
is [forceescape, This is an example of a Flask 
ilter; it allows us to effect the input before we 
render — in this case it’s escaping our values 
or us. There are many, many different built- 
in filters that come included with Flask. Your 
advisor recommends a full reading of all the 
potential options. 


1 Wrapping up 

That’s pretty much it for templating 
with Flask. As we've seen, it’s insanely quick 
and easy to build and deploy dynamic sites. 
Flask is great tool for any Python developer 
looking to run a web service. Although we've 
used Twitter to demonstrate Flask’s power, 
all of the techniques described can be used 
with any third-party service or database 
resource. Flask can work with other rendering 
engines, such as Handlebars (which is 
superb), but Jinja2 still needs to be present 
to run Flask and conflicts can occur between 
the two engines. With such great integration 
between Flask and Jinja2, it makes little 
sense to use another engine outside of very 


specific circumstances. 


tweetRequestParams = { 
“oauth_consumer_key” : consumer_key, 
“oauth_nonce” : helpers.nonce(32), 
“oauth_signature_method” : “HMAC-SHA1”, 
“oauth_timestamp” : int(time.timeQ), 
“oauth_version” : “1.0”, 
“oauth_token” : session[,Adoauth_token’], 
“user_id” : session[‘user_id’], 
“count” : str(count) 


tweetRequest = helpers.sign_request(tweetRequestParams, “GET”, 
“https://api.twitter.com/1.1/statuses/user_timeline.json”, consumer_secret, 
session[‘oauth_secret’]) 


tweetRequestParams[“oauth_signature”] = tweetRequest 


makeRequest=urllib2.Request(“https://api.twitter.com/1.1/statuses/ +! 
user_timeline.json?count=” + tweetRequestParams[‘count’] + “&user_id=” 
+ tweetRequestParams[‘user_id’]) 


del tweetRequestParams[‘user_id’], tweetRequestParams[‘count’ ] 


makeRequest.add_header “Authorization”, helpers.create_oauth_ 
headers(tweetRequestParams)) 


try: 

httpResponse = urllib2.urlopen(makeRequest) 
except urllib2.HTTPError, e: 

return e.read() 


{% if data %} 


<ul id="tweets”> 
{% for tweet in data %} 
<li> 
<div class=” image’”’> 
<img src="{{ tweet[‘user’ ][‘profile_image_url_https’] 
}y’ alt="User Profile Picture”> 
</div> 
<div class="text”> 
<a>{{_ tweet[‘text’]|forceescape }}</a> 
</div> 
</li> 
{% endfor %} 
</ul> 


{% else %} 


<p>We didn’t get any tweets :«</p> 
{% endif %} 
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Django comes witha 


lightweight development 
server so you can test all 
your work locally pepe mmm 


First Post 


Rob 7 on Marck 14 201), kd am 


ab 2 om March 04, 2012, Slt pm 
Vow ve macenatilly tnade 4 very fem bomal biog in Dpangye! Cong analanan! 


Django is of course able 
to read and write to SQL 
databases, but it needs 
very little prior knowledge 
to succeed in doing so 


Using HTML and CSS in 
conjunction with Django is 
clear and straightforward; 
it’s much easier to bug-fix 
than PHP 


Django comes with 

a generic back-end 

site that is set up in 
seconds, and easily 
customisable after that 


Resources 
Python Source Code 


www.python.org/download/releases/2.7.2 
Django Source Code 


www.djangoproject.com/download 
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Build your own blog 
with Django 


Learn how to use this extremely powerful 
Python-based web framework to create a 
complete blog from scratch in record time 


Creating your own blog always feels like a 
great accomplishment. Sure, you could use the 
fantastic WordPress if you need a complete blog 
with every feature you'd ever need right now. And 
Tumblr exists for people who just want to write 
something, or post pictures of corgis in space. 
You don't have full control from start to finish 
with a prefabricated blog, though, and neither 
of these is written in the fantastic Django. 
Django is of course based on Python, the object- 


orientated programming language designed to 
have clearly readable syntax. Due to its Python 
base, it’s an incredibly powerful and simple-to- 
use language for web development with a vast 
array of applications. 

So let’s use it to make a blog. In this first 
section of the process we will explore how to set 
up Django, writing and reading to a database, 
creating a front- and back-end, and some 
interactions with HTML. 
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01 Install Python 

Django is based on Python, and requires 
it to be installed to develop on. Python 2.7 is the 
recommended version, and this is installed with 
the python package. If you want to check your 
version, start the Python shell by typing ‘python’ 
into the terminal. 


0 Install Django 

Most operating systems will have a 
Django package available in the repository, like 
python-django in Debian. The Django website 
has a list if you have trouble finding it, or you 
could build it from source. Make sure you install 
version 1.3. 
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@) Verify your Django 

To make sure Django installed properly, 
and that you have the right version, enter the 
Python shell by typing ‘python’ and 


import django 
print django. get_version() 


It will return a version number if it has installed 
correctly, which should be 1.3. 


Start anew project 
In the terminal, cd to the folder you 


0 


want to develop the blog in, and then 


django-admin startproject myblog 


Here, ‘myblog’ can be replaced by whatever you 
wish to name the project, but we'll use it for the 
upcoming examples. 


0 Start the development server 
Django comes with a_ lightweight 

development server to test out work locally. We 

can also use it to check our work, so cd to the 

myblog folder and 

python manage.py runserver 


If all goes well, it should return zero errors. Use 
Ctrl+C to exit the server. 


Configure the database 

The database settings are kept in the 
settings.py file. Open it up with your favourite 
editor and go to the Databases section. 


0 


‘ENGINE’: ‘django.db.backends.sqlite3’ , 
And in NAME, put the absolute path — for 
example: 

‘NAME’: ‘/home/user/projects/myblog/ 
sqlite.db’, 

Save and exit. 


07 Create the database 
The database file will be generated by 


python manage.py syncdb 
During the creation, it will ask you to set up a 


superuser, which you can do now. 
The SQLite database file will be created in 


your myblog folder. 
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0 Create your blog 
Now it’s time to create a blog app in your 


project. 
python manage.py startapp blog 


This creates the models file which is where all 
your data lives. You can change ‘blog’ to another 
name, but we'll use it in our examples. 


@) Start your blog model 

We can now take the first steps in 
creating our blog model. Open models.py and 
change it so it 
from django.db import models 
class Post(models.Model): 
post = models. TextField() 


This creates the Post class, which has a 
subclass that contains your blog text. 


1 Customise your blog 

Let’s now expand the blog modela bit so 
it resembles a more classic blog: 
class Post(models.Model): 

post = models. TextField() 

title = models. TextField() 

author = models.CharField(max_ 
length=50) 

pub_date = models.DateTimeField() 


A CharField needs to have a_ character 


limit defined, and DateTimeField holds the 
time values. 
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© You don't have full control from start 
to finish with a prefabricated blog — but 
you will with Django 


File Edit View Search Terminal Help 


z-man@Z-LaptopMint 
7 -man@Z-LaptopMint 
z-man@Z-LaptopMint Djang 

settings .pyc 
|z-man@Z-Laptopmint Djang 


a/t 


sqlite3.db 


CREATE TABLE “Bleg_post™ ( 
“id” integer NOT NULL PRIMARY KEY, 


“post” text NOT NULL, 
“title” text NOT NULL, 
“author” varchar(S@) NOT NULL, 
pub date” datetime NOT NULL 
) 
COMMIT 
2-man@Z-Laptopmint } blog $ [J 
Install your app 


1 1 Your app needs to be installed to your 
project, which is very simple. Open the settings. 
py file again, go to the INSTALLED_APPS section 


‘blog’ , 


python manage.py sql blog 


python manage.py syncdb 


1 Set up to post 

Now we can create a post and test out 
our code. First though, 
python manage.py shell 


Then execute these commands to add all the 
necessary fields and data: 

from blog.models import Post 

import datetime 


Terminal 


! yt 1$cd~ 
ed Django/myblog/ 
myblog $ sudo nano s 
blog $ sudo nano settings.py 


3 $ python manage.py sql blog 


1 3 Let’s blog 
Create the post. For this example, we 


test_post = Post() 


test_post.post = ‘Hello World!’ 
test_post.title = ‘First Post’ 
test_post.author = ‘Me’ 
test_post.pub_date = datetime. 
datetime .now() 


test_post.save() 


1 Start the site back-end 
To create the admin site, edit urls.py 
from the myblog directory, and uncomment or 


from django.contrib import admin 
admin. autodiscover () 
url(r’*admin/’, include(admin.site. 
urls)), 


Save and exit, then edit settings.py and 
uncomment this line from INSTALLED_APPS: 
‘django.contrib.admin’ , 


The admin site is now at 127.0.0.1:8000/admin/. 


1 Setup the admin page 

The admin page has a generic, usable 
template, but you need to configure it to view, 
edit, create and delete posts. First, create a new 
file admin.py in the blog directory 
from blog.models import Post 
from django.contrib import admin 


admin. site.register(Post) 


To have the posts display nicely on the site, edit 
models.py 
class Post (models.Model): 


def __unicode__(self): 
return self.title 


python manage.py syncdb 


The admin page is now usable! You should be 
able to see the other posts, and it’s now a lot 
easier to add more. 


1 Activate the front-end 
Open up urls.py from the myblog 
directory in your editor and 


url(r’“myblog/’, ‘blog.urls.index’)), 
One of the examples in the file can be 
uncommented and edited to this as well. It 
points to a model we will now create. 


1 Create another urls file 

You need to create another urls file in the 
app directory, in our case blog/urls.py. Create it 
and 
from django.template import Context, 
loader 
from blog.models import Post 
from django.http import HttpResponse 
def index(request) : 

post_list = Post.objects.all() 

t = loader.get_template(‘blog/ 
index.html’) 

c = Context({ 

‘post_list’: poll_list, 
) 


return HttpResponse(t.render(c)) 


ul 
. = Django is an incredibly powerful 


and simple-to-use language if! 


1 Start the template 
The code we've just written looks for a 
template that currently doesn’t exist. We first 
need to tell Django where templates are to be 
looked for in settings. py: 
TEMPLATE_DIRS = ( 
‘/home/user/projects/templates’ , 


) 


You can put the template directory wherever you 
want, as long as it’s referenced here. 


1 Write a template 
Now to write the site template. In our 
example, we're using index.html: 
{% for post in post_list %} 
{{ post.title }} 
{{ post.author }} 
{{ post.pub_date }} 
{{ post.post }} 
{% endfor %} 


This needs to be located in a folder with 
the same name as your app within the 
template directory. 


am Hello Work? 


2 View your handiwork 

Let’s make sure this worked. Start the 
developer 
python manage.py runserver 


And navigate to 127.0.0.1:8000/myblog/. 

It’s not pretty, but you should have 
successfully called upon your stored data. We'll 
spend the next steps tidying it up a bit. 


2 Format the front page 

Go back into the template file, 
index.html, and 
{% for post in post_list %} 

<h2>{{ post.title }}</h2> 

{{ post.author }} on {{ post.pub_ 
date }} 

<p>{{ post.post }}</p> 
{% endfor %} 


This is just an example — the post can be in any 


order with any tags. 
2 Spruce up the admin list 

We'll do this in the admin.py file in our 
blog directory; open it in your editor and make 
the 
from blog.models import Post 
from django.contrib import admin 
class Admin(admin.ModelAdmin) : 

list_display = [‘title’, ‘author’, 

‘pub_date’ ] 
admin.site.register(Post, Admin) 


In this case ‘list_display’ is a fixed variable name. 
A logical post page 


2 The new post page on the site might 
not be in an order you're comfortable with. 
We'll change that now in admin.py with the 


class Admin(admin.ModelAdmin) : 

list_display = [‘title’, ‘author’, 
‘pub_date’ ] 

fields = [‘title’, ‘pub_date’, 
‘author’, ‘post’ ] 
admin.site.register(Post, Admin) 
Remember to save! 
2 A functional blog 

So there you have it! Navigating to 

127.0.0.1:8000/admin/ or 127.0.0.1:8000/myblog/ 
will show off the fine work you've created. 


Django is dead easy to use once you know how, 
and there are plenty of tweaks you should be 


able to make after this tutorial. 
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With Django we can make Django has built-in code to Allow your readers to With minimal extra code, 

simple sidebars that list deal with pagination very give you feedback, and our template can display 

archives by month cleanly and effectively moderate them in the the month archive from 
admin panel the sidebar 


Deliver content to your blog 


We continue building an awesome blog using the powerful 
Django framework, and this tutorial is all about the front-end 


content delivery 
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Resources 
Python base: 


http://www.python.org/download/ 
Django source: hitps:/www. 


djangoproject.com/download/ 


In the last tutorial we began to build the most 
basic of blogs, and learned how to use a bit of 
Django in the process. We can now set up anew 
project, create a database and write basic code 


to read and write to the database. All simple 
stuff, but of course it’s core to building websites 
where Django might be called upon. 

Here we will give the front end of the site 
an overhaul, making it more of the standard 
you would expect from a modern blog. This 
will include a sidebar, pages, post pages and 
the ability to add and moderate comments. 
In the process we will learn some more of 
the benefits that come with using Django to 
develop websites. 

You should keep using Django 1.3 for this 
tutorial, as we did before. 


ke EGR View Search Terminal Help 


djange.teaplate iepert Context, Loader 
« blog.madets inpert Post 
= djange.nttp Lempert 


0 New blog order 

We left off last time with the blog 
displaying posts in chronological order, which 
isn’t very helpful to readers. To correct this, 
open up urls.py in the blog folder and edit the 


post_list = Post.objects.all().order_ 
by(“-pub-date”) 


This makes sure that posts are displayed in 
reverse order (newest first). 
0 Aview toa page 

You'll want to be able to link specific 
pages, of course, and to do that we first have to 


define what goes into these pages in the urls.py 
file in the 


def post_page(request, post_id): 
post_page = Post.objects. 
get (pk=post_id) 
return render_to_response( ‘blog/ 
post.html’, {‘post_page’: post_page}) 


0 Clean up your code 

You may notice that we used a different 
return command to the index definition — this 
is a shortcut that makes writing the code a bit 
easier. To get it working, add: 


from django.shortcuts import render_to_ 
response 

We recommend that you edit the index code to 
match post_page. 


Django is Awesome! 
Rob Z on March 14, 2012, 503 pm 

You've successfully made a very temctional blog in Django! Congramdations: 
First Post 

Rob 7 on Math 14. I? 653 2m 


Heli Work!’ 


0 Edit URLs 

In urls.py in myblog we need to make 
some additions and modifications for the 
website to direct to the 


url(r’*myblog/$’, ‘blog.urls.index’), 
url(r’ *myblog/(?P<post_id>\d+)/$’ , 
‘blog.urls.post_page’), 

The post_id is the number of the post, which is 
auto-generated. The ‘$’ is important to make the 
redirection work. 


Me Oct View Search Terminal Help 


P2>({ pest _page.titie })} 
{{ post page.author )) on {{ 


6 post page.pub date }) 
({ post page.post )) 


0 Apost template 

We told the post_page to point towards 
a template we now need to create. In the same 
location as index.html, create post.html with the 
following formatting to resemble the 


<h2>{{ post_page.title }}</h2> 


{{ post_page.author }} on {{ post_page. 
pub_date }} 


<p>{{ post_page.post }}</p> 


fhe Cit View Search Terewne! Melee 


9) Link to the page 
Let’s get these links working from the 


main page. Open up the index.html file and make 
the RASARRGERERSE 


<h2><a href=/myblog/{{ post.pk }}>{{ 
post.title }}</a></h2> 

This is a very simple addition using an absolute 
link, and requires no fiddling with the views 
or model. 


07 Pagination 
To get blog posts split up over pages, we 


need to make some additions to urls.py in the 


post_list = Post.objects.all() .order_ 
by (“-pub_date”) 

paginator = Paginator(post_list, 3) 
try: list_page = request.GET.get(“list_ 
page”, ‘1’) 

except ValueError: list_page = 1 
post_list = paginator.page(list_page) 
return render_to_response( ‘blog/index. 
html’, {‘post_list’: post_list}) 


Please turn over 
Now we need to add the navigation 
links to the blog, so open the index template 


0 


{% if post_list.has_previous %} 

<a href=”?list_page={{ post_list. 
previous_page_number }}”’>Newer </a> 
{% endif %} 
{% if post_list.has_next %} 

<a href=”?list_page={{ post_list. 
next_page_number }}”’> Older</a> 
{% endif %} 


a 
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Wrong page 


0 Let’s add a quick bit of code to return 
somebody to the previous page if they get the 
URL wrong: 


from django.core.paginator import 
Paginator, EmptyPage, InvalidPage 


try: 
post_list = paginator.page(list_ 
page) 
except (EmptyPage, InvalidPage) : 
post_list = paginator. 
page(paginator .num_pages) 
The last part replaces ‘post_list = paginator. 
page(list_page)’. 


1 Have your say 

Everyone has their opinion on the 
internet. You can give your readers the ability to 
comment, and we'll start 


class Comment (models .Model) : 

author = models.CharField(max_ 
length=50) 

text = models. TextField() 

post = models.ForeignKey(Post) 

def __unicode__(self): 

return (self.post, self.text) 

We've made it so they can put their name with 
acomment. 


1 Back to the comment 

We now need to add a small line to the 
urls.py file in myblog so the comment can be 
posted then sent 


url(r’ *myblog/add_comment/(\d+)/$’ , 
‘blog.urls.add_comment’), 

This URL pattern calls the ID of the page that 
you're on. 
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We need to be able to process the 
data and metadata in the forms 


12 Form acomment 

We need to be able to process the 
data and metadata in the forms, so let’s add 
a class to urls.py in the blog folder with the 


from django.forms import ModelForm 
from blog.models import Post, Comment 
class CommentForm(ModelForm) : 
class Meta: 
model = Comment 
exclude = [‘post’ ] 


13 In the | post 
We need to attribute the comments to 


the post they're being made on, so update the 


from django.core.context_processors 
import csrf 
def post_page(request, post_id): 
post_page = Post.objects. 
get (pk=post_id) 
comments = Comment.objects. 
filter (post=post_page) 
d = dict(post_page=post_page, 
comments=comments, form=CommentForm()) 
d.update(csrf (request) ) 
return render_to_response( ‘blog/ 
post.html’, d) 
The CSRF tag 
request forgery. 


is to prevent cross-site 


1 Comment template 
Let’s get the post page ready for 
comments by 


<p>Comments : </p> 
{% for comment in comments %} 
{{ comment.author }} 
<p>{{ comment.text }}</p> 
{% endfor %} 
<strong>Add comment</strong> 
<form action=”"{% url blog.urls. 
add_comment post_page.id %}” 
method=”POST”>{% csrf_token %} 
Name {{ form.author }} 
<p>{{ form.text }}</p> 
<input type="submit” value=”Submit”> 
</form> 


1 5 Define your comments 
The final step is defining the comments 
in blog/urls.py, 
def add_comment (request, comment_id): 
p = request.POST 
if p.has_key(‘text’) and pL‘text’]: 
author = ‘Anonymous’ 
if pL‘author’]: author = 
pL‘ author’ ] 
comment = Comment (post=Post. 
objects. get (pk=comment_id)) 
cf = CommentForm(p, 
instance=comment) 
cf.fields[ ‘author’ ].required = 
False 
comment = 
cf.save(commit=False) 
comment.author = author 
comment .save() 
return HttpResponseRedirect (reverse 
(‘blog.urls.post_page’, args=[comment_ 
id])) 
This ensures text has been entered, and if not 
specified author is ‘Anonymous’. Before testing, 
runsyncdb so comment tables can be created. 


File Edit View Scarch Terminal Heip 


from blog.models import Post, Comment 
trom django.contrib import admin 


Lass PostAdmin(admin.ModelAdmin) : 


list_display = [‘title’, ‘author’, ‘pub_date’] 
fields = [‘title’, ‘pub_date’, ‘author’, ‘post"] 
admin.site.register(Post, PostAdmin) 
Lass CommentAdmin(admin.Model Admin) 
list display = [‘text’, ‘author’, ‘post*] 


admin.site.register(Comment, CommentAdmin) 


1 Administrate 

Like the posts, we can get the 
Admin page to see comments. Start editing 
blogs/admin.py to get this 


from blog.models import Post, Comment 
from django.contrib import admin 
class PostAdmin(admin.ModelAdmin) : 

list_display = [‘title’, ‘author’, 
‘pub_date’ ] 

fields = [‘title’, ‘pub_date’, 
‘author’, ‘post’ ] 
admin.site.register(Post, PostAdmin) 


1 Comment-specific admin features 
Now we can add the comment-specific 
admin features without causing any clashes: 


class CommentAdmin(admin.ModelAdmin) : 
list_display = [‘text’, ‘author’, 

‘post’ ] 

admin.site.register(Comment, 

CommentAdmin) 

This will show the comments on the admin site, 

and you can see the comment, the author and 

the post it’s connected to. 


1 Sidebar beginnings 

Django makes it pretty easy to order 
posts by years and months, but first we need to 
import some new models into blog/urls. py: 


import time 

from calendar import month_name 

We're going to define two new functions, 
month_timeline and month, to make the sidebar. 


1 Start to define month_timeline 
First we need to get all the information 
from the posts: 


def month_timeline(): 
year, month = time. localtime()[:2] 
begin = Post.objects.order_by(‘pub_ 
date’ )[@] 
month_begin = begin.pub_date.month 
year_begin = begin.pub_date. year 
month_list = [] 
The ‘[:2]) makes sure we only get the time 
information we need. 


Finish your definition 
Now we will order the posts by month 
and year starting from our first month. 


2 


for y in range(year, year_begin-1, -1): 
start, end = 12, @ 


if y == year: start = month 
if y == year_begin: end = month_ 
begin-1 


for m in range(start, end, -1): 
month_list.append((y, m, 
month_nameLm])) 
return month_list 


2 Return to reader 
With the list organised, we can now 
define month so we can display it on the blog: 


def month(request, year, month): 

post_list = Post.objects. 
filter(pub_date__year=year, pub_date__ 
month=month) 

return render_to_response( ‘blog/ 
index.html’, dict(sidebar_list=post_ 
list, month_list=month_timeline())) 
Now we need to link it up to the index template. 
2 Finalise your sidebar definition 

Edit the return command on the index 

function to include the sidebar information: 


return render_to_response( ‘blog/index. 
html’, dict(post_list=post_list, 
sidebar_list=post_list.object_list, 
month_list=month_timeline())) 

Then add this line to urls.py in myblog so a 
month page can be rendered: 

url(r’ *myblog/month/(\d+)/(\d+)/$’ , 
‘blog.urls.month’), 

All we need to do now is display the information 


onthe site. 
2 Sidebar on the web 

Go to the index template. First of all, 
change the first line of the post forloop to: 


{% for post in sidebar_list %} 
Simple enough. Now we need to add the 
sidebar information: 
{% for month in month_list %} 

<p><a href=’{% url blog.urls.month 
month.@ month.1 %}’>{{ month.2 }}</a></ 
p> 
{% endfor %} 


Sidebar finale 

Obviously it’s not at the side right now 
— that’s a job for the HTML and CSS. The info is 
there, though, and you can manipulate it any 
way you want. However, your blog is now a lot 


2 


more friendly to your readers. 


The Python Book 153 


Resources 
Python base: 


http://www.python.org/download/ 


Django source: hitps://www. 
djangoproject.com/download/ 


Enhance your blog 
with extra features 


To add to the previous tutorials, we'll 
cover some of the more advanced 
features you can utilise with the 


power of Django 


We've been building our Django blog to create 
and display posts, allow people to make 
comments, and filter posts by month like a 
classic blog sidebar. We still have a bit of a 
way to go until it looks and behaves more like a 
classic blog, though. 

In this tutorial, we're going to add in 
summaries, excerpts, categories and finally an 
RSS feed. This allows us to look at a few things — 
firstly we'll get a better understanding of cross- 


Pagination Part 2 


Paginathon Part I 


Django by Awesome 


@) Summarise 
On a normal blog we're going to have 
much longer articles. We can generate a 
summary of each of these on the index page 
template like so: 
<p>{{ post.post|truncatewords:3 }}</p> 
This automatically takes the first three words 
of the post — of course, you can use any number. 


o We're going to add summaries, 
excerpts and an RSS feed i! 
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model referencing and how that works in the 
admin site. We will also go through how to make 
changes to the database, and how Django helps 
when creating an SQL query. 

Finally, the RSS feed is part of a standard 
feed library in Django itself. We will learn how 
to import and use it to create a simple list of the 
latest entries that click through to the posts. By 
the end of the tutorial your Django blog will be 
finally finished! 


0 Manual excerpt 
Ifyou don’t want an automatic summary, 
we can add an excerpt field to our post model so 
you can craft one manually: 
excerpt = models. TextField() 
To limit the characters in your excerpt, use a 
CharField like for our author section. 


0 Write an excerpt 

To write the excerpt, or append it to the 
previous posts, we'll have to add it to the admin 
page. Open up admin.py and edit the fields 
section of the AdminPost class to add excerpt: 
fields = [‘title’, ‘pub_date’, 
‘author’, ‘post’, ‘excerpt’ ] 


Have automatic summaries or manually 
crafted excerpts for your blog posts 
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Select post to change 


Create custom 
RSS feeds using 
built-in Django 
functions 


a a 


| Esta 
0 4 Excerpt or summary 

You can replace the post content in the 
index template with the excerpt, but we can keep 
itas a backup for ifthe excerptis empty: 
{% if post.excerpt %} <p>{{ post. 
excerpt }}</p> {% else %} <p>{{ post. 
post|truncatewords:3 }}</p> {% endif %} 
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Django ts Awesome! 


you'll have noticed our web server has stopped 
working. This is because there is no excerpt 
column in our database. Therefore we need to 
add the excerpt column. To find out how, run: 

$ python manage.py sqlall blog 


06 Database query 

The output will show you what the SQL 
code is to add the models to the database. We 
want to add the excerpt field specifically, which 
should look something like this: 

“excerpt” text NOT NULL 

Make a note of it. 


enter Sk statements 
eqlites ALTER TAMLE * 


9) Alter table 

To get into the database shell and add 
the field, run: $ python manage.py dbshell 
Then we need to use an ALTER TABLE query: 


Sutrcribe Now, 


ALTER TABLE “blog_post”. 
And then enter the code we noted down like so: 
ADD “excerpt” text; 


0 Save the changes 

We've removed NOT NULL as we 
already have entries that won't have an excerpt, 
and want to make it so an auto Summary can be 
made. Save the changes with: COMMIT; and then 
exit the shell with: . quit 


0) Test it out 

Now we can test out the excerpt code — 
create a new post or edit an existing one to have 
an excerpt. If you've followed our steps correctly 
it should work; if not, you may need to do a bit of 


bug fixing. 


a 
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comments, we want to add a ForeignKey to 
the Post model so we can attribute a post to a 
category. Add this line: category = models. 


Foreignkey (Categories) Tide can now 


And move Categories to the top of models. py. 


create categories 
separately 


1 Category model 

We can add a model for blog categories: 
class Categories(models.Model): name 
= models.CharField(unique=True, 1 Database category 
max_length=200) slug = models. Like before, we'll find outthe SQLneeded ~ : 
SlugField(unique=True, max_length=100) — toalter the table: $ python manage.py sqlall 1 Category display 


parent = models. ForeignKey(‘self’, blog Which for our example returns a somewhat As our urls.py in the blog directory gets 

blank=True, null=True, related_ different code than before: “category_id” all the post fields, to the index template we just 

name=’ child’) def __unicode__(self): integer NOT NULL REFERENCES “blog_ add: <p>Category: {{ post.category }}</ 

return (self .name) categories” (“id”) It’s an|D we're getting, not | P?And tothe post template: <p>Category: {{ 
This allows for parent and child categories. text, from the categories table. post_list.category }}</p> 


1 Alter table — part 2 1 7 Category page 

Again let’s enter the database shell: First we need to define our category in 

python manage.py dbshell We'll continue blog/urls.py. Import Categories and then add: 
= : much like before, but with the new code: ALTER def blog_categories(request, category_ 

1 Administrate categories TABLE “blog_post” ADD “category_id” id): categories = Categories.objects. 

; Weean add rte one admin a by integer REFERENCES “blog_categories” get (pk=category_id) We need the 
elite a ASAE We old sede in adinin-py: (“id”) ; And finally, to save: COMMIT ; category_id to call the corresponding posts. 
class CategoriesAdmin(admin. 
ModelAdmin): list_display = [‘name’ , 
‘slug’, ‘parent’] fields = [ ‘name’, werwavente tom pu coe |) set compen 
‘slug’, ‘parent admin. site, register pean rrr 
(Categories, CategoriesAdmin) ' 


Before we can make categories, though, we 
need to create the database table: 
$ python manage.py syncdb 
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1 Administrate categories — part 2 
Now we can go back to admin.py and add the new category fields to the PostAdmin model: 
list_display = [‘title’, ‘author’, ‘pub_date’, ‘category’] fields = [‘title’, 
‘pub_date’, ‘author’, ‘post’, ‘excerpt’, ‘category’ ] Our previous blog posts with no 
category have disappeared! To fix this, go back to models.py and make this change to the Post model: 
1 Categorise the posts category = models.ForeignKey(Categories, blank=True, null=True) So we can now create 
Similarly to what we did with the categories separately, assign them to posts, and view posts without a category. 
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1 8 Category definition 

Finish the definition by using the parent_ 
id to filter the correct Posts, then render the 
response: category_posts = Post.objects. 
filter(category=categories) return 
render_to_response(‘blog/categories. 
html’, dict(category_posts=category_ 
posts, categories=categories) ) 
Again we're calling a new template that we'll 
construct shortly. 


1 Category URLs 

We'll create the URL in urls.py as for the 
post page, only it’ll give the slug of the category 
instead of an ID in the link: url (r’ “myblog/ 
category/(?P<category_id>\d+/$’, ‘blog. 
urls.blog_categories’), 


2 Category template 


We'll use something similar to the Index 


and Post template to create a category page 


template: {% for post in category_posts 
%} <h2><a href=/myblog/{{ post.pk }}>{{ 
post.title }}</a></h2> {{ post.author 


}} on {{ post.pub_date }} % if post. 


excerpt %} <p>{{ post.excerpt }}</p> {% 
else %} <p>{{ post.post|truncatewords: 3 


}}</p> {% endif %} <p>Category: {{ 
post.category }}</p> {% endfor %} 


2 Category clickthrough 
Finally, let’s make the categories click 
through to the relevant page by changing the 


o Finally, let’s make the categories 
click through to the relevant page il 


category display to be: <p>Category: <a 
href=/myblog/category/{{ categories. pk 
}}>{{ post.category }}</a></p>This can go 
on the categories, post and index template. 


2 RSS 

Django has a built-in RSS framework. 
In blog/urls.py add: from django.contrib. 
syndication.views import Feed class 
BlogFeed(Feed): title = “Blog Feed” link 
= “/” def items(self): return Post. 
objects.order_by(“-pub_date”) def item_ 
title(self, post): return post.title 


2 RSS links 

We need to define item_link for the 
feed so that the feed items can link to the right 
place. We have to give the complete URL and 
the post ID for it work: def item_link(self, 
post): link = “http://127.0.0.1:8000/ 
myblog/”+str(post.pk) return link 


oe et te oe 


24 RSS URLs 
The final step is adding the feed 


URL to urls.py: url (r’ *myblog/feed/$’ , 
BlogFeed()) , And now your blog is now fully 
functional. With a bit more tweaking and 
theming, you can get it online and blog away! 
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Raspberry Pi 


16:46 


LZ 


Sent from the Twillio Sandbox 
Number - Hey! Did you know you 
can send text messages from your 
Pi? 


Close Reply 
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160 Programming in Python on Raspberry Pi 


Learn how to optimise for Pi 


164 Turn Ras Pi into a stop motion studio 
Create a stop-motion film 


168 Send an SMS from Raspberry Pi 


Combine simple Python code and Twilio 


170 Build a complex LED matrix 
Build and program this useful light display 


“The Raspberry Pi takes the 
‘Pi’ of its name from Python, 
as the official Pi language” 


aiatouaytnlelansiee).am Fs) 
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Programming in Python 
on the Raspberry Pi 


Learn the basics of programming in Python with the Raspberry 
Pi, laying the foundations for all your future projects 


3 
4 
5+ 


It’s good practice to describe 
what the program’s purpose is at 
the top of the file. This will help 
you out when working on larger 
projects with multiple files 


It’s important to think about data 
types. We convert the number to 
decimal to make sure that we 
don’t lose any decimal numbers 
during arithmetic 


Resources 


ARaspberry Pi with all 
necessary peripherals 


An SD card containing the 
latest Debian image for the 
Raspberry Pi 


http://www.raspberrypi.org/downloads 
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8| import s 


@| from decimal import * 


irstName = 
14] print 


The stopping condition for a while loop 
has to be satisfied at some point in the 
code; otherwise the loop will never end! 


This tutorial follows on from the one last 
issue: ‘Setting up the Raspberry Pi’, where we 
showed you how to prepare your SD card for 
use with the Raspberry Pi. The beauty of using 
an SD card image is that the operating system is 
ready to go and a development environment is 
already configured for us. 

We'll be using a lightweight integrated 
development environment (IDE) called Geany 
to do our Python development. Geany provides 
a friendlier interface compared to text-based 


The print function can only accept string 
data types, so we need to convert any 
variables with a number data type to a string 
before we can print them to the screen 


editors such as nano and will make it easier to 
get into the swing of things. 


This tutorial will cover topics suchas: 
* basic arithmetic 


* comparison operators, for example ‘equal to’ 

and ‘not equal to’ 

¢control structures, for example loops and if 
statements 

By the end, we'll have an advanced version of our 

‘hello world’ application. Let’s dive straight in... 


File Edit Go Bookmarks View Tools 


+ OO O ZF home 


WW 


& pi 
BME Desktop 
] | Rubbish 
a Applications 
_ 16 GB Filesystem 


Desktop 


0 Staying organised 

We don’t want to have messy folders on 
our new Pi, so let’s go to the file manager and 
organise ourselves. Open the file manager by 
clicking the icon next to the menu icon on the 
bottom left of the screen. Create a new folder 
by right-clicking and selecting New>Folder, then 
type a name and click OK. We created a folder 
called Python, and inside that created a folder 
called Hello World v2. 


Gis fae geen ew De omen Peed Bold: pels eh 
eo'd AG 20 090 €O- bh B 
Sytrbolt Documents od. py @ 


No tags found : 


0 Starting Geany 
Start Geany by going to the LXDE menu 


and going to Programs. From here, select Geany. 
Once you're in the Geany interface, create a new 
Python file from a template by selecting ‘New 
(with template)»main.py’.. Delete everything in 
this template apart from the first line: #!/usr/ 
bin/env python. This line is important because it 
means you can run the code from the command 
line and the Bash shell will know to open it with 
the Python interpreter. 


Help 


Scratch 


O Saving your work 


It’s always a good idea to keep saving 
your work with Ctrl+S as you program, because 
it would be a shame to lose anything you've been 
working on. To save your file for the first time, 
either press Ctrl+S or go to the File menu and 
select Save. Give the file a sensible name and 
save it in the tidy folder structure you created 
before. It’s a good habit to be well organised 
when programming, because it makes things 
much easier when your projects become bigger 
and more complicated. 


import sys 
# Import everything from th 


SCSOONOUBWNHe 


from decimal import * 


e 


eaten using the addition operator 
with strings, they are joined together 


0 Setting it up 

Having detailed comments in your 
code is important because it allows you to note 
down things you find confusing and document 
complex procedures. If another programmer has 
to work with your code in the future, they'll be 
extremely grateful. Start by adding a comment 
with a description of what the program will do 
and your name. All comment lines start with a 
hash (#) and are not interpreted as code by the 
Python interpreter. We import the sys library 
so we can use the sys.exit function to close the 
program later on. We also import everything 
from the decimal library because we want to 
make use of the decimal type. 


2 
Lh) firnthom 


'@) Variables 

A variable is data that is stored in 
memory and can be accessed via a name. Our 
program is going to start by asking for your 
first name, store that in a variable and then 
print out a welcome message. We're going to 
add a comment that explains this and create 
a variable called firstName. Notice how we've 
capitalised the first letter of the second word to 
make it easier to read. We want the firstName 
variable to hold the value returned by a function 
called raw_input, that will ask the user for input. 
The question is passed into the print function 
within brackets, and because this is a string 
it is enclosed within quotation marks. A string 
type is basically a collection of characters. Note 
the extra space we've added after the colon 
because the user types their input straight after 
this question. 


14 print("Welcome " + firstName + "\n") 


0 Printing a message 

Now that we have a value in firstName, 
we need to output a welcome message to the 
screen. We print to the screen in Python using 
the print function. The print function is followed 
by a pair of brackets which enclose the values 
to print. When using the addition operator 
with strings, they are joined together. Note 
how firstName doesn’t need to be enclosed by 
quotation marks because it is the name of a 
variable. If it was enclosed in quotation marks, 
the text firstName would be output. We finish off 
by adding a ‘\n’ character (new line character) to 
our output to leave one blank line before we start 
our next example. 


/ 


a 
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icon before running the program, 
or anything you’ve done since you last 
saved won't be interpreted 


Enter tool paths below. Tools you do not need can be left 


Preferences 
General Tool paths 
Interface 
blank. 
Toolbar 
Editor Terminal: |xterminal 
Files 
Browser: |sensible-browser 
Tools 
Templates Grep: grep 
Keybindings 
Y 9 Commands 
Printing Context action: 
Terminal 


07 Fixing a small issue 
The Debian image that we’re currently 


using has a small misconfiguration issue in 
Geany. You'll know if you have this problem by 
trying to run your program with either the Fd 
key or going to the Build menu and selecting 
Execute. If the issue is present then nothing 
will happen and you'll see a message saying 
‘Could not find terminal: xterm’. Not to worry, it’s 
easy to fix. Go to the Edit menu and then select 
Preferences. Go to the Tools tab and change the 
value for Terminal from xterm to lxterminal. 
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O Testing our program 

Now we've done that part, why not test 
it? It’s worth noting that you have to save before 
running the program, or anything you've done 
since you last saved won't be interpreted by 
Python. Run the program by pressing the F5 key. 
nput your name by typing it and then pressing 
he Enter key. Once you have done this, you'll see 
a welcome message. If the program exits with 
he code 0 then everything was run successfully. 
Press Enter to close the terminal. 


16 
17 number — 


O Working with numbers 

We're going to ask the user for a number 
by basically repeating the first couple of lines 
we did. Once the user gives us a number, we'll 
halve, square and double it. The raw_input 
function returns the value that the user input 
as a string. A string is a text-based value so 
we can’t perform arithmetic on it. The integer 
type in Python can only store whole numbers 
whereas the decimal type can store numbers 
with decimals. We're going to do something 
called a type cast, which basically converts a 


value with one type to another type. We're going 
to convert our number string to a decimal value 
because it’s likely that decimals will be involved 
if we are halving numbers. If the number was of 
an integer type, any decimal values would simply 
be cut off the end, without any rounding. This is 
called truncation. 


19 numberHalved = number / 2 
20 numberDoubled = number * 2 
numberSquared = number * number 


21 
10 Performing arithmetic 

The main arithmetic operators in Python 
are + - / *, the latter two being divide and 
multiply respectively. We've created three new 
variables called numberHalved, numberDoubled 
and numberSquared. Notice that we don’t need 
to specify that they should be decimal because 
Python gives a type to its variables from the 
type of their initial value. The number variable 
is a decimal type, so all values returned from 
performing arithmetic on that number will also 
be of adecimal type. 


23 

24 

2 print(*ihe result of halving that numbe 
26 print(*The result of doubling that numb 
27 print(*The result of squaring that numb 
238 print(*") 


1 Printing our numbers 

Now that we have performed our 
arithmetic, we need to print the results using 
the print function. The print function only 
accepts string values passed to it. This means 
that we need to convert each decimal value to 
a string using the str() function before they can 
be printed. We're using a print statement with 
nothing between the quotation marks to print 
one blank line. This works because the print 
function always adds a new line at the end of 
its output unless told otherwise, so printing an 
empty string just prints a new line. 


sithe print 
function only 
accepts string 
values, so convert 
each decimal 
value to a string 


30 # The stopping 

31 yesOrNo = False 

32 

33 # A while Loop that 


34 while yesOrNo == False: 


35 result = raw_input("Do you want to continue? 

36 

37 if result == "yes" or result == "no": 

38 yesOrNo = True 

39 else: 

40 print("Error, please type yes or no" + "\n") 


1 Input validation with While loops 
and If statements 

To demonstrate a while loop and if statements, 
we will output a question to the user that 
requires a yes or no answer. We're going to ask 
them if they want to continue — and for this we 
require either a lower-case ‘yes’, or a lower- 
case ‘no’. A while loop is a loop that runs until a 
condition is met. In this case, we will create a 
variable called yesOrNo and the while loop will 
run while yesOrNo is false. The yesOrNo variable 
will be a Boolean type that can be either True or 
False. The variable will be initialised with a value 
of False, or the while loop will not run. 

A while loop has the format ‘while [condition]: 
— where any code that is part of the while loop 
needs to be indented in the lines below the 
colon. Any code that is not indented will not 
be part of the while loop. This is the same for 
an if statement. The condition is checked with 
the comparison operator ‘==’. A single ‘=’ is an 
assignment operator whereas a double equals 
is a comparison operator. Another common 
comparison operator is ‘!=’ — which means ‘not 
equal to’. 

We create a variable called ‘result’, which 
holds the result of the question, do you want to 
continue? We then check this result is valid with 
an if statement. Notice the ‘or’ operator which 
allows two conditions to be tested. If the user 
inputs a correct value then we set yesOrNo to 
True, which stops the while loop on the next run. 
Otherwise, we output an error message and 
the while loop will run again. The user can use 
the Ctrl+C command at the terminal to exit the 
program at anytime. 


42 th t 

43 aif Pemulk == "yes": 

44 print ("\nContinuing" ) 
45 


else: 
46 print ("\nExiting") 


1 Continue or exit? 

Next we will deal with the result 
that was stored during the while loop with if 
statements. If the user typed ‘yes’ then we 
will print ‘Continuing’. Otherwise, we will print 
‘Exiting’ and then call the sys.exit function. You 
don’t have to do anything else for the program 
to continue because it will simply carry on if the 
sys.exit function wasn’t called. This code also 
shows that the newline character \n can be 
used anywhere in a string, not just in separate 
quotation marks like above. 


# Create the count 
Sait. = 21 


1 4 Loops with numbers 


We'll be using a while loop that uses a 
number and a <= (less than or equal to) operator 
as its stopping condition. The while loop will be 
used to increment the number by 1, printing the 
change on each loop until the stopping condition 
is met. The count variable allows us to know 
exactly how many times we have been through 
the while loop. 


52 

53 print ("Incrementing the number by 
S54 

ss while count <= 5: 

S6 number += 1 

57 print("number + + str(count) 
ss 

sg 

60 count += 1 


1 5 Incrementing numbers with a loop 

The while loop will run until the count is 
6, meaning that it will run for a total of 5 times 
because the count begins at 1. On each run, the 
while loop increments the number variable and 
then prints what is being added to the original 
number, followed by the result. Finally, the count 
is incremented. 


(yes/no) ") 


o The count 
variable lets us 
know exactly how 
many times we 
have been through 
the while loop 


print 


16 Finishing off 
The final step is to print that the 


program is exiting. This is the last line and we 
don't have to do anything else because Python 
simply finishes when there are no more lines 
to interpret. 


1 Admire your work 

Now that we've finished coding, save any 
changes you have made and run your program 
with the F5 key. 


/ 
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Turn your Raspberry Pi 
into a stop-motion studio 


Build your own animation studio by using your 
Raspberry Pi as a stop-motion camera 


Resources 


Hard drive 
OSMC: 


osmc.tv/ 
Home network 


Another Linux computer, less than 
eight years old 


Below Our home-made 

antenna may looka little 
rough around the edges, 
but it works great! 


What have you done with your Raspberry 
Pi camera lately? While it gives us plenty of 
new ways to use the Pi, unless you've got your 
computer set up as a security webcam or you're 
particularly a fan of time-lapse photography, the 
chances are that you've overlooked the Pi camera 
module for a while. 

If you're a fan of animation or you simply want 
to extend the possibilities of the module, why not 
build a stop-motion camera? By using Python 
and an external button to capture images, 
the Raspberry Pi can be the perfect tool for 
animators. 

Better still, you can go beyond animating toys 
or bits of LEGO and go old school by mounting 
the Pi on a rostrum and creating a cartoon. Even 
if you can’t buy or build one, you can mount the 
stop motion Pi camera with a smartphone mount 
for stability. 


0 Mount your stop-motion Pi 
camera 
Before you get started, think about the type of 
animation you're going to be capturing. If you're 
using the traditional top-down method, as used 
by classic cartoon animators, then you'll need a 
rostrum to mount the Raspberry Pi. 
Alternatively, you may be = animating 
something on a desk, table or perhaps the 


floor, but you'll need your Pi camera mounted 
in a similar way, looking across rather than 
down. 

Various options are available, such as 
smartphone tripods and dashboard mounts. 
Most of these should be suitable for securely 
mounting your Raspberry Pi. 


@) Find somewhere to shoot 

For your first attempts at shooting 
a stop-motion video, you should use a wide 
and uncluttered space. This might be a desk, 
a kitchen work surface or even the floor, but it 
should be a hard and flat area in most cases 
(unless you have need for a bumpy carpeted 
environment for your video) to aid with the 
creation of your stop-motion film. 

As time progresses and your skill develops, 
other surfaces can prove useful alternatives, but 
keep it simple for now and stick with flat surfaces 
while you get to grips with the art form using the 
Raspberry Pi stop-motion camera. 


0 Connect the Pi camera module 

Next you'll need to connect the Pi 
camera module to your Raspberry Pi. All models 
have the necessary connector, although where 
it is found on the device will depend on the 
version of your Raspberry Pi. 


The Model A has the Pi-camera connector next to the Ethernet port, as 
does the Model B. On the B+ and the Raspberry Pi 2, the connector is ina 
similar position, but it’s a little further from the Ethernet port between the 
audio-out and HDMI ports. 

Connecting the camera module can be tricky. Begin with taking your Pi 
out of its case or remove the top where possible and disconnect all cables. 
Take precautions before removing the device from its antistatic bag, as the 
camera module is very sensitive to static electricity. 

On the Pi, lift the plastic catch on the connector and slot the camera 
module flex into place with the shiny contacts facing away from the 
Ethernet port. Once the flex is fully slotted in, push the plastic catch back 
into place. 


0) Test your Pi camera module 

After connecting the Pi camera, check that it works by booting the 
Raspberry Pi (we’re assuming you're running Raspbian) and entering this in 
the command line: 


fl sudo raspi-config 


With the keyboard arrows, move down to option five, ‘Enable Camera’, and 
tap Enter. In the following screen, hit Enter again to enable the camera 
and exit. If you're not already signed into the GUI, do so now (if you're in the 
command line interface, enter startx to launch the desktop view). Open 
the terminal and enter: 


fl raspistill -o imagel.jpg 
You can review the resulting image in your Home directory. 


@) 5 Straighten out the image 

With the Pi camera up and running, you may notice that it’s 
outputting the image with the axes flipped. We can fix this using Python, so 
open the terminal and enter: 


Left Consider the angle 
you'll be shooting from 
as you are setting up 


Right With the camera 
module, ensure the 
shiny side faces away 
from the Ethernet port 


| sudo apt-get install python-picamera python3- 

picamera 
I) sudo idle3 
In the Python editor, open File>New Window and enter the code below, 
setting the camera.flip and camera.hflip as True or False as required. 
Save (perhaps as ‘camflip.py’), then press F5 to run the script and view the 
correctly outputted image. 

To save time, however, you might try rotating the position of 
your camera or Pi camera module! 


import picamera 
from time import sleep 


with picamera.PiCamera() as camera: 
camera.vflip = True 
camera.hflip = True 
camera.start_preview() 
sleep(3) 
camera.capture(‘/home/pi/image2. jpg’) 
camera.stop_preview() 


@) Set up the breadboard and button 

We have two ways to add a button to the Raspberry Pi, but before 
proceeding, ensure you have switched the computer off and disconnected it 
from the mains. You should also disconnect any cables and hardware. 

The simplest method of adding a button is to employ a solder-free 
breadboard and a single-state pushbutton. Connect the button to the 
breadboard with two male-to-female wires running to GPIO pins GND and 
17. With a script designed to detect action from the button on the GPIO, each 
frame of your animation can be captured with a single button push. 
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-_ (Don’t wantto build your own 
rostrum? Why bother when a 
camera tripod can be positioned 
as needed? it) 


Tripods and 
suction 
holders 


EE 


Don’t want to build 

your own rostrum? Why 
bother when a camera 
tripod can be positioned 
as needed and other 
items, like smartphone 
suction holders and 
grips, can be employed 
to hold your Raspberry Pi 
case and camera module 
in place? 


For top-down animation, 
suction-pad smartphone 
holders (available for 
under £10) that usea 
sticky gel for a stronger 
grip are perfect for 
holding your stop-motion 
Pi camera and attaching 
toa flat surface above 
the animation subject. 
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@) Code for stop motion 

Once satisfied with the results of your Pi 
camera, it’s time to turn it into a stop-motion camera. 
The first step is to type up the code shown below, 
which will capture an image of your subject and save 
it into a folder called ‘Stop motion’. Each image is 
numbered sequentially and they can all be stitched 
together once your animation is complete. Save the 
code as animation.py: 


import picamera 
from RPi import GPIO 


button = 17 


GPIO.setmode(GPIO.BCM) 
GPIO.setup(button, GPIO.IN, GPIO.PUD_UP) 


with picamera.PiCamera() as camera: 
camera.start_preview() 
frame = 1 
while True: 
GPIO.wait_for_edge(button, GPIO. 
FALLING) 
camera.capture(‘/home/pi/animation/ 
frame%Q3d. 
jpg’ % frame) 
frame += 1 
camera.stop_preview() 


Then, ina new terminal window, enter the following: 
| sudo python3 animation.py 
Press the button to capture each frame, moving the 


subject as needed. When you're all done, hit Ctrl+C to 
terminate the script. 


O Stitch together your stop-motion animation 

The collected images can be cycled through relatively 
quickly using a special picture viewing app, but for a true 
animation you will need to compile them into one single file. In the 
terminal, install ffmpeg: 


q sudo apt-get install ffmpeg 


After installing, you can then convert your images into a video 
clip, as follows: 


q ffmpeg -y -f image2 -i /home/pi/Desktop/stop- 
motion/frame%@3d.jpg -r 24 -vcodec libx264 -profile 
high -preset slow /home/pi/Desktop/stop-motion/ 
animation.mp4 


With this file created, open with the commana: 
fi omxplayer animation.mp4 
The video will then be played in full-screen mode. 


0 Use an app instead 

Don’t fancy using the script? Try this stop-motion 
application. Begin by installing the raspicam-extras package 
that includes the UB4L drives for the Pi: 


1 wget http://www. linux-projects.org/listing/uv41_ 
repo/Irkey.asc && sudo apt-key add ./Irkey.asc 

i sudo sh -c ‘echo “deb http://www. linux-projects. 
org/listing/uv4l_repo/raspbian/ wheezy main” >> / 
etc/apt/sources.list’ 

} sudo apt-get update 
sudo apt-get install uv4l uv4l-raspicam uv4l- 
raspicam-extras 


With that done, enter: 

q sudo apt-get install stopmotion 

Launch with the stopmotion command to open a GUI with a 
live camera for you to line up each shot. This is a more elegant 
solution and captured images can be stitched together using the 
‘Number of images’ slider and the camera button above it. 


Above Here’s the stopmotion program in action — it’s a simple enough GUI to get 
your head around and gives you a nice preview window 


1 Put it all together 
Now you have the camera set up, a device for keeping it steady 

(whether a DIY rostrum or a tripod), and you’ve constructed a button or 
plan to capture each frame via SSH. Your stop-motion Raspberry Pi 
camera is finally ready! 

By now you’re probably aching to get started, so with your stop-motion 
Pi camera ready to use (and close to a power supply), it’s time to start 
building your film set. While this might simply be an empty table top, 
there might equally be a few props you would like to include. 


1 Storyboard your shoot 
It’s easy to get tied up with the idea of creating a stop-motion camera 
and forget all about a subject and how it will act. 

You can avoid any problems here by taking the time to carefully plan what 
will happen in your film: your story. Remember, each second of the video will 
require 26 frames! 

The best way to plan at this level is to simply write up an outline, but 
beyond this you may prefer to storyboard instead by making pencil sketches 
to help you progress the story. 


1 Cast your stop-motion shoot 

You'll also need a good idea of what your subject will be; this means 
who or what you're going to be using the stop-motion camera to capture 
frames of. Typically, amateur stop-motion films make use of household 
objects, toys and child’s play clay. 

The beauty of this kind of animation is that you can use almost anything 
that you can get your hands on, from a cup and saucer to an Action Man, as 
long as you have a way to support the subject(s) in the positions you wish 
them to take throughout. 


1 Stop-motion with toys 

If you cast toys as your stop-motion stars, you will get a much better 
result from something that is built to stand up on its own than toys that tend 
to sit or fall over. 

LEGO sets and Minifigs appear in many stop-motion productions on 
YouTube. This is with good reason, as they’re really easy to place in a desired 
position. The construction element of the bricks is also a major attraction. 
Another popular option is Transformers toys. These are both good places to 
start, but you should aim to develop your own approach over time. 


1 People in stop-motion films 

It isn’t only inanimate objects that you can include in stop-motion 
films. People can feature too! Pop videos such as Peter Gabriel’s 1985 
hit Sledgehammer have taken advantage of stop motion (that video was 
produced by Aardman Animations, the eventual creators of Wallace and 
Gromit) and the technique can be used on humans to create surreal effects. 
If you want your subject to be moving around a room too, they can appear to 


be floating or gliding. The results can be strange, but useful if you know what 
you want. 


1 Make your own Wallace and Gromit 

Known as ‘claymation’, the practice of animating lumps of clay has 
been a popular form of animation for years in the UK, but there’s more to 
it than just clay. These forms, whether they're cheese-loving old men or 
remarkably clever dogs, have a wire skeleton that is used to keep movement 
inthe desired position. 

This makes it much easier to capture the frames efficiently, but for the 
best results you should also have several versions of the same figures 
available. This is just in case one gets deformed and damaged during 
production! 


1 From stop motion to time lapse 

Similar to stop motion, time lapse is a technique that automatically 
captures images on a preset timer. We can use a Python script to control 
this, saving the captures in a directory and using ffmpeg to compile them 
into afilm. 

However, what you may not want for this project is a mains cable trailing 
all over, especially if you're attempting to capture the movement of the stars 
at night or nature activity. We suggest employing a Pi-compatible battery 
pack to make your time-lapse Pi camera truly mobile, using SSH to run the 
script remotely: 


import time 
import picamera 


VIDEO_DAYS = 1 
FRAMES_PER_HOUR = 62 
FRAMES = FRAMES_PER_HOUR * 24 * VIDEO_DAYS 


def capture_frame(frame): 
with picamera.PiCamera() as cam: 
time.sleep(2) 
cam.capture(‘/home/pi/Desktop/frame%23d.jpg’ % frame) 


for frame in range(FRAMES): 


start = time.timeQ 
capture_frame(frame) 


time.sleep( 
int(6Q * 6@ / FRAMES _PER_HOUR) - (time.time() - start) 
) 


1 Take your stop-motion studio to the next level 
At the risk of encouraging you to become the next Ivor Wood (creator 
of The Wombles, Paddington and Postman Pat, among others), it is possible 
to use the Raspberry Pi’s camera module for ambitious projects as well as 
small ones. After all, this device photographs in high resolution so there is no 
reason not to adopt this setup and incorporate it into a working stop-motion 
studio with a miniature set. 
Sharing your work through YouTube is a great idea too, especially as it will 
make it simple to add a soundtrack using YouTube's browser-based editor. 


/ 
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Send an SMS from your 
Raspberry Pt 


Create a program that combines Twilio and simple Python 


code to enable you to send an SMS (text message) from your 
Pi toa mobile phone 


Text messaging, or SMS (Short Message 
Resources 


Service), has become a staple of everyday 
Raspberry Pi communication. What began life as a 40 pence 
ee message service is now offered by most tariff 
Twilio account providers as an unlimited service. Twilio, a cloud 
communications company, enables you to send 
SMS messages for free from your Raspberry Pi toa 
mobile phone using just six lines of code. 


Set up your Twilio account 

The first step of this project is to register 
for a Twilio account and Twilio number. This is free 
and will enable you to send an SMS to a registered, 
verified phone. Once signed up, you will receive a 
verification code via SMS to the registered phone. 
When prompted, enter this onto the Twilio site to 
authenticate your account and phone. Go to twilio. 
com/try-twilio and create your account. 


Raspberry Pi Register and verify mobile numbers 
Your Twilio account is a trial account (unless 
16:46 you pay the upgrade fee), which means you can only 
send and receive communications from a validated 
phone number. Enter the phone number of the 
Sent from the Twillio Sandbox mobile that you want to verify, ensuring that you 
Number - Hey! Did you know you 


select the correct country code. Twilio will text you 
send text messages from your a verification code. Enter this code into the website 
can 
Pi? you could get your 


Withthis method, form and press submit. 
Pi to drop you a text 


when it finishes 
running a script 


vA 


Reply 


Mespherry Pi Medel @+ ¥ 
fespberry #1 2e14 
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DASHAOARD GETTING STARTED CONMPIGauURE 


Voice, SMS & MMS 


API Credentials 


To use the Twilio API you will need your AccountSid and Auth Toker 


ACCOUNT SD 


Ready to remove trial restrictions and enjoy full benefits? 


Leam more about trial accounts & 


Sandbox App = United states 
Test Your App © 


Call with twilio client 


9) The dashboard 

Once registered and logged in, visit the dashboard 
page, which will display your AccountSid and your Auth Token. 
These are both required to use the Twilio REST. Keep these 
secure and private, but be sure to make a note of them as you 
willneed them for your Python program later. 
@) Install the software 

Boot up your Raspberry Pi and connect it to the 

Internet. Before you install the Twilio software, it is worth 
updating and upgrading your Pi. In the LX Terminal, type sudo 
apt-get update, then sudo apt-get upgrade. Once complete, 
type sudo easy_install twilio or sudo pip install twilio to 


install the software. (If you need to install pip, type sudo apt- 
get install python-pip python-dev, press Enter, then type 


sudo pip install -U pip.) 
@) Twilio authentication 

Now you are ready to create the SMS program that 
will send the text message to your mobile phone. Open your 
Python editor and import the Twilio REST libraries (line one, 
below). Next, add your AccountSid and Auth Token, replacing 
the X with yours, as you will find on your dashboard: 


from twilio.rest import TwilioRestClient 
account_sid = “XXXXXXXXXXXXXXXXXXXXX” 
# Enter Yours 
} auth_token = “XXXXXXXXXXXXXXXXXXXXX” 
# Enter Yours 
| client = TwilioRestClient(account_sid, auth_ 


token) 
0 Create your message 

You will probably want to be able to change your 
text messages rather than send the same one. Create a new 
variable in your program called message. This will prompt you 
to enter the phrase that you want to send to the mobile phone. 
When the program runs, this is the message that will be sent: 


| message = raw_input(“Please enter your message”) 


s LOGS USAGE Docs HELP ~ 


COMFFRENCES 


AUTH TOKEN 


Uparade your account 


Developer Tools 


Generate your code for the Twilio API 


Above You will be able to find your AccountSid and your Auth Token on the Twilio dashboard 


x Twilio enables you to send 
SMS messages for free 


0 Add your numbers 

To send the message, you need to add the code line 
below and your two phone numbers. The first number is your 
mobile phone number, which is registered and validated with 
Twilio (Step 2). The second number is your Twilio account 
number, which can be retrieved from your dashboard page 
under ‘Call the Sandbox number’. Change the Sandbox number 
to your country location and remember to add the international 
country code. 


l] message = client.messages. 
create(to=“+44YOURMOBNUMBER”, 
from_=“+44YOURTWILIONUMBER”, body=message) 

Send the message 


0 Now send your message. The code below is not 
required, but useful to indicate your message has been sent. 
Add the lines and save your program. Ensure your Raspberry 
Pi is connected to the Internet and that your mobile is on, 
then run your program. You have just texted from your 
Raspberry Pi! 


print message.sid 

print “Your message is being sent” 

print “Check your phone!” 
0 Other API and codes 

Twilio provides a wide range of API codes and 

reference documents to create other communication 
programs, such as making phone calls, recording a call, and 
retrieving data including caller IDs and call duration. The 


API also complements a wide range of languages, including 
Ruby, PHP, Java and Node,js (twilio.com/api). 


REST 


REST stands for 
Representational 
State Transfer. (It 

is sometimes spelt 
“ReST”.) It relies on 

a stateless, client- 
server, cacheable 
communications 
protocol — andin 
virtually all cases, the 
HTTP protocol is used. 
REST is an architecture 
style for designing 
networked applications. 
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16x 220 Ohm Resistor 
Source code: 


Build acomplex LED matrix 


LED Matrix display systems find use everywhere from gaudy 
kebab shops to impressive steampunk-styled systems 
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Driving LEDs in an efficient fashion is a science of its own. 
The common availability of single-board computers has put 
the necessary technology within reach of everyone. 

When dealing with LED displays, two different systems 
must be considered. We will focus on traditional matrix- 
based systems made up of one or more LEDs. Their 
affordable nature makes them ideally suited to classic display 
applications: they communicate currency prices, provide 
stock-brokers with updates from the trading floor and have 
even been used as basic displays for primitive oscilloscopes. 
Finally, we will also provide you with an overview of 
electronic basics. This tutorial is a bit more advanced than the 
ones we usually run in this section of the magazine, and it’s 
also worth noting that we're going to be programming with C 
rather than Python. Follow along using the code listing annos. 


Think about LEDs 

Standalone LEDs are primitive — they light up once 
current flows through them. Driving a few LEDs is as easy as 
connecting them to GPIO pins along with a resistor. Sadly, this 
method becomes wasteful once more than a few of them get 
involved — driving 16 diodes ties up 16 pins. 


Arrange your diodes 

Methods were devised to reduce the number of pins 
needed. Matrix-based systems are resilient to individual 
diode failures, and provide a pin-to-LED ratio of n=(n/2)*2. The 
following steps assume a 16x16 LED matrix which is made 
up according to Figure A. Since LEDs permit current in only 
one direction, you can enable a single LED by bringing the 
corresponding pins high and low. 


x Our LED model has a 
total of 32 inputs, which 
overwhelms older 
versions of the RPi 
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Above The extended version of this schematic is inside FileSilo.co.uk 
— just sign in and download 


03 Harness the MUX 
Our LED module has a total of 32 inputs, which 


overwhelms older versions of the RPi. The first way to restrict 
their number comes in the shape of the 74HC238, a component 
described as a 3-to-8 line decoder/demultiplexer. Its function is 
described in the Figure B image on the next page. 


0 Separate concerns 

Chip two goes by the name of 74HC244, which is 
described as an octal buffer with tri-state capability. Tri-State 
outputs can physically disconnect themselves from the bus 
line. This permits you to tie their outputs together without 
fear of short circuits. As long as all but one chip are in tri-state 
mode, no current can flow between high and low output pins. 


9) Round them up 

Four GPIO pins control the enabled display ‘line’. 
Three pins configure the address which is to be emitted, 
while the signal emitted from the fourth pin is connected to 
the activity inputs. This ensures that but one IC is active. The 
74HC244 ensures that but one of the two groups is active. 


@) Configure the pins 

We used a library from Hussam Al-Hertani’s 
Hertaville blog (hertaville.com/2014/07/07/rpimmapgpio). 
The first step involves setting output functions. As the GPIOs 
are set to outputs, the tri-state feature might connect the 
internal state to the output pins of the IC. This could lead to 
internal shorting if the output is not turned off. 


Full code listing 
[Step 12m 


Step 07 void setAddress(unsigned char _which, mmapGpio* _where) 


{ 
if(_whiché1) 
{ 
_where—>writePinHigh (PINAO) ; 
} 
else 
{ 
_where->writePinLow(PINAO) ; 
} 
if (_which&2) 
{ 
_where->writePinHigh(PINA1) ; 

} 
else 
{ 

_where—>writePinLow(PINA1) ; 
} 
if (_whiché4) 
{ 

_where->writePinHigh (PINA2) ; 

} 
else 
{ 

_where—>writePinLow(PINA2 ) ; 
} 
if (_whiché8 ) 
{ 

_where-—>writePinHigh (PINA3) ; 
} 
else 
{ 

_where—>writePinLow(PINA3) ; 
} 


} 
Step 08 void safelySetRow(unsigned char _which, mmapGpio* 
{ 
_where-—>writePinHigh(PINCSO) ; 
_where—>writePinHigh(PINCS1) ; 
i.£(_which==0) 


{ 
_where—>writePinLow(PINCSO) ; 
} 
else 
{ 


_where) 
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07 Power the MUX 
Create a convenience function taking an address 


ranging from zero to 15. It is converted into pin outputs for our 
3-to-8-demultiplexer. The effect of this is that all but one of 
the sixteen rows is to be supplied with energy. 


O Select a row 

In the 74HC244, we first disable both units and proceed 
to turning on the one which is needed. This sequence prevents 
ghosting during the switching process. 
9) Do the main loop 

The outer part of the loop consists of logic that 

manages the addressing of the individual rows. Our program 
must flash the individual LED groups one after another using 
the building blocks described in the next step. 


1 Complete the loop 

Writing out data is accomplished in a sequence of three 
commands. We select the row, configure the column and then 
write out the data bits that are to be displayed. A small pause 
is observed in order to give the LEDs some time to ‘burn into’ 
the viewer’s eyes. 


Above Digital LED matrices like this one give you far more control over 
each individual ‘pixel’ in the display 
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Full code listing 


{ 


_where—>writePinLow(PINCS1) ; 


if(_whiché&1) 
{ 
_where—>writePinHigh(PINDO) ; 


_where—>writePinLow(PINDO) ; 
} 
if(_whiché2) 
{ 

_where—>writePinHigh(PIND1) ; 


_where—>writePinLow(PIND1) ; 


i£(_whichs4) 


{ 

_where—>writePinHigh (PIND2) ; 
} 
else 
{ 

_where—>writePinLow(PIND2) ; 
} 
i£(_whiché8) 
{ 

_where—>writePinHigh(PIND3) ; 
} 
else 
{ 

_where->writePinLow(PIND3) ; 
} 
if (_whiché16) 
{ 

_where-—>writePinHigh(PIND4) ; 
} 
else 
{ 

_where—>writePinLow(PIND4) ; 
i 
if (_which&32) 
{ 

_where—>writePinHigh(PIND5) ; 
} 
else 
{ 

_where—>writePinLow(PINDS) ; 
} 
if (_which&64) 
{ 

_where—>writePinHigh (PIND6) ; 
} 
else 
{ 

_where—>writePinLow(PIND6) ; 
} 
if£(_whiché128) 
{ 

_where—>writePinHigh (PIND7) ; 
} 
else 


void setData(unsigned char _which, mmapGpio* _where) 


LED 
stripes 
—EEEs 


Two versions of LED 
strips are offered. 
‘Primitive’ ones are 
based on analogue 
technology. Init, an 
entire strip of diodes 
has the colour set 
by the three input 
pins. Systems such 
as the mega-display 
shown in the left- 
hand image require 
the use of the 
digital version. They 
are based onthe 
concept of the shift 
register. Your system 
inputs individual 
colour values which 
are then pushed on 
along the strip. 
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Above This is the full schematic of the LED matrix that we’re working 
with here (you can also view it at its full size on FileSllo) 


1 Energy control 

LEDs light up if current flows through them. SetData pulls 
the pins of the 74HC244 low to ensure that the energy supplied 
from the 74HC238 can flow through the diode. 


1 Avoid GPIO trouble 

The Raspberry Pi Foundation has a tendency to change 
the layout of the expansion header regularly, a habit which 
professional manufacturers of process computers abhor. 
It’s recommended to handle the mapping between pins and 
functions via a set of defines. Our code is optimised for a 
Rev2 Raspberry Pi with a ‘short’ header — 40-pin variants will 
require readjustments making sure the physical pin numbers 
correspond to the logical GPIO numbers. 


1 Add example data 

Test the code by setting the datastore to a value of your 
choice. Setting 64 to all fields will disable one row in each part 
of the display. 


1 Kick it off 

Check all connections between the planar and the 
single-board computer, and proceed to starting the compiled 
app. Don’t forget to use the sudo command — direct memory 
access is restricted to root in order to prevent apps from 
causing havoc in the physical memory. Users are accustomed 
to this, so requiring them to put a sudo in front of the 
command doesn’t cause concern. 
1 5 Notice a flicker 

Sharp-eyed readers will notice an occasional flicker 

where one line appears brighter than the others. This is 
caused by the stalling of the program — if the kernel does 


other work, the switching routine can’t run. We could solve 
this problem by using a real-time Linux kernel. 


Full code listing 


{ 


_where-—>writePinLow(PIND7) ; 


} 
} 


int main(void) 


{ 


mmapGpio rpiGpio; 


rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 


rpiGpio. 
rpiGpio 


rpiGpio. 
rpiGpio 
rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 
rpiGpio. 


setPinDir(PINAO,mmapGpio: 
setPinDir(PINA1,mmapGpio: 
setPinDir(PINA2,mmapGpio: 
setPinDir(PINA3,mmapGpio: 


setPinDir(PINCSO,mmapGpio: 
-writePinHigh(PINCSO) ; 


setPinDir(PINCS1,mmapGpio: 
-writePinHigh(PINCS1) ; 

setPinDir(PINDO,mmapGpio: 
setPinDir(PIND1,mmapGpio: 
setPinDir(PIND2,mmapGpio: 
setPinDir(PIND3,mmapGpio: 
setPinDir(PIND4,mmapGpio: 
setPinDir(PIND5,mmapGpio: 
setPinDir(PIND6,mmapGpio: 
setPinDir(PIND7,mmapGpio: 


: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 


: OUTPUT) ; 


: OUTPUT) ; 


: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 
: OUTPUT) ; 


Step 10 


L 


unsigned c 


har dataStore[2][16]; 
0;5<2; j++) 


0;k<16;k++) 


dataStore[j][k]=64; 


kCounter=0; 
‘ounter=0; 
e(1) 


ounter++; 


if (blockCounter==16) 


owCounter==0 ) 


ockCounter=0; 


rowCounter=1; 


ockCounter=0; 


rowCounter=0; 


safelySetRow(rowCounter, &rpiGpio) ; 
setAddress(blockCounter, &rpiGpio); 
setData (dataStore[rowCounter][blockCounter], &rpiGpio) ; 
usleep(50); 


for(int j= 
{ 
for(int k= 
{ 
} 
} 
int bloc 
int row 
whil 
{ 
blockc 
{ 
if(x 
{ 
bl 
} 
else 
{ 
bl 
} 
} 
} 
return 0 
} 


’ 
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